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^ ! 1 Introduction. 



Let (0,J^, P, F) be a complete filtered probability space, on which a one-dimensional standard Brownian 
motion W{-) is defined with F = {J-t}t>o being its natural filtration augmented by all the P-null sets. 
Consider the following controlled linear stochastic differential equation (SDE, for short): 

j dX{s)=\A{s)X{s) + B{s)u{s)\ds+\c{s)X{s)+D{s)u{s)\dW{s), s e [t,T], 

(1.1) < L J L J 

[ X{t) = X, 
with a quadratic cost functional 

(1.2) J{t,x;ui-))^Et[f [{Q{s)X{.s),X{s)) + {R{s)uis),uis))ys + {GX{T),X{T))y 

Here, A{-), B{-), C(-), -D(-), Q{'), R{') are suitable matrix-valued (deterministic) functions, G is a matrix, and 
Ft = E[ • I J"t] stands for the conditional expectation operator. In the above, X{-), valued in R", is called the 
state process, u{-), valued in M™, is called the control process, and (t,x) £ i^ is called the initial pair where 



\{t,x) \ t £ [0,T], X is J'f-mcasurable, E|x'p < cxd L 



*This work is supported in part by NSF Grant DMS-1007514. 
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Denote 



^ 



[t,T] = L^(i,r;R™) = (u : [t,T] X n ^ R™ | u(-) is F-progressively measurable, 



E 



\u{s)\'^ds < oo >, 



which is the set of all control processes. Under some mild conditions on the coefficients, for any initial 
pair {t,x) G ^ and a control m(-) e ^[t,T], the state equation (1.1) admits a unique solution X{-) ~ 
X{- ;t,x,u{-)), and the cost functional J{t,x]u{-)) is well-defined. A standard linear-quadratic (LQ, for 
short) optimal control problem can be stated as follows. 



Problem (LQ). For any given initial pair (i,x) £ ^, find a u*{-) e '^[t,T] such that 



(1.3) 



A - 



J(t,x;u*(-))= inf J(t,x;u(-)) =V(t,x). 

u{-)e'^irlt,T] 



Any u*{-) G '^[t,T] satisfying (1.3) is called an optimal control for the given initial pair (t,x), the corre- 
sponding state process X*{-) is called an optimal state process for (i,x), {X*(-),u*{-)) is called an optimal 
pair for (t, x), and V{- , •) is called the value function of Problem (LQ). 

It is well-known that ([29]) under proper conditions, the above Problem (LQ) admits a unique optimal 
pair {X*{-),u*{-)). Moreover, the following Riccati equation 

Pis) + P{s)A{s) + A{sfP{s) + CisfPis)Cis) + Qis) 

-[P{s)B{s) + C{sfP{s)D{s)][R{s) + D{sfP{s)D{s)]-^[B{sfP{s) + DisfPis)Cis)]^0, 

(1-4) i se[0,T], 

PiT) = G, 
^ det [R{s) + D{sfPis)D{s)] > 0, s e [0, T], 

has a unique solution P(-) which is positive definite, and the optimal control u*(-) admits the following state 
feedback representation: 



u*{s) = -e(s)x*(s), 



e[t,T] 



(1.5) 

with 

(1.6) Q{s) = [R{s) + D{sfP{s)D{s)] "' [B{sfP{s) + D{sfP{s)C{s)] , 

and X*{-) being the solution to the following closed- loop system: 



sG[o,r], 



(1.7) 



dX*{s) = [A{s) ~ B{s)Q{s)\X*{s)ds + [C{s) ^ D{s)Q{s)\X*{s)dW{s), s e [t,T], 
X*{t) =cc. 



Further, the value function V{- , ■) is explicitly given by 

(1.8) V{t,x)=^{P{t)x,x), V(i,.T)e 

Next, if $(• ; •) is the fundamental matrix of (1.7), i.e.. 



(1.9) 



d$(s; t) = [A{s) - B{s)e{s)] $(s; t)ds + [C{s) - D{s)e{s)] $(s; t)dWis), s G [t, T], 

Ht;t)=i, 

2 



then 

(1.10) X*{s) = ^{s;t)x, yse[t,T], {t,x)e&, 
and 

(1.11) M*(s) =u*(s;i,x) = -e(s)*(.s;i)a;, s e [t,Tl (t,x) e 9. 

Note that O(-) is independent of the initial pair (t, x). According to the above representation of the optimal 
pair, if we start from the initial pair (r, X*{t)) e & with r G (t, T] being any F-stopping time, then we have 

u*{s]t,X*{t)) = -e{s)<^{s;T)X*{T) = -e(s)$(s;T)$(T;i)a; 
= ~e{s)'^{s;t)x = u* (s;t,x), s € [t,T]. 

This means that the restriction u*{- ;t,x)\, j,-, oi the optimal control u* (■ ;t,x) for the initial pair (t, x) 6 i^ on 
a later time interval [t,T] coincides with the optimal control m*(- ;t,X*{t)) for the initial pair {t,X*{t)) G S^. 
Such a phenomenon is called the time- consistency of Problem (LQ). 

We now look at the situation for the following cost functional: 



T 



J\t, X- u{-)) = E,| y^ e-^(«-*) [ ( Q{s)X{s), X{s) ) + { R{s)u{s), u{s) ) 



ds 



-e 



\GX{T),X{T))], 



for some constant A > which is referred to as a discount rate. We also call the function s ^^ e ^'^ an 
exponential discounting. If we denote 

Q{s) = e-^'Q{s), R{s)^e-^'R{s), G ^ er^^G, 

then 

(^ ^3) Jit, X- u{-)) ^Et I [ ( Q{s)Xis), X{s)) + { Ris)u{s),u{s) ) ] ds + ( GX(T), X(r) ) ' 

= e-^*J^(f,x;w(-)). 

Therefore, the optimal controls for the problems with resepective cost functionals (1.12) and (1.13) coincide. 
Since the problem with cost functional (1.13) is time-consistent, so is the problem with cost functional (1.12). 

Note that the significant difference between the cost functionals J^{t,x;u{-)) defined by (1.12) and 
J{t,x;u{-)) defined by (1.2) is that the running cost rate and the terminal cost of J'^{t,x;u{-)) explicitly 
depend on the initial time moment t. However, from the above, we see that such a special dependence on t 
does not change the time-consistency of the problem. The reason is that exponential discounting exhibits a 
time-consistent memory effect. 

It then will be interesting to know what will happen if we replace the exponential discounting by some 
general discounting function. To get some feeling, let us look at the following simple example. 

Example 1.1. Consider a one-dimensional controlled linear SDE: 

dX{s)^uis)ds + X{s)dW{s), s e [t,T], 



(1.14) 

X{t) = x. 
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J{t,x;u{-))^Et / p{s,t)\u{s)\^ds + g{t)\X{T)\' 



with cost functional 
(1.15) 



where p{s,t) and g{t) are deterministic non-constant, continuous and positive functions. Let P{- ,t) be the 
unique solution to the following Riccati differential equation: 



(1.16) 



Observe the following: 



P(s t)'^ 

Ps{s,t) + Pis,t) ^-^ = 0, s€[t,T] 



p{s,t) 



P{T,t)=git). 



E, 



/I 
(P,(s, t)X{sf + 2P(s, t)X{s)u{s) + Pis, t)X{sf^ 



ds. 



Hence, 



J{t,x;u{-))=Et / p{s,t)\u{s)\^ds + g{t)\X{T)\ 

i-T 



Pit,t)x''+Et / (^p{s,t)\uis)\^ + 2Pis,t)X{s)uis) + [P,(s,t) + P(s,t)]X(s)2) 



ds 



2 , ^ /^„.„.^,..„^ , Pis.t) 2 



= P{t,t)x'+Et / pis,t)u{s) + 



Xis) 



ds. 



Let 
(1.17) 



u*{s; t, x) = -^^j^X*{s; i, x), s e [t, T], 



p{s,t) 
with X*{- ; i, .t) being the solution of the following closed-loop system: 



(1.18) 



Then 



dX*{s; t, x) = - ^, ,, X*(s; i, a;)rfs + X*(s; i, x)dW{s), 



p{s,t) 



X*{t] t, x) = x. 



&[t,T], 



inf J(t,x;u(-)) = J{t,x;u*(- ;t,x)) = P{t,t)x^. 
u{-)e'^[t,T] 

Hence, for any r e {t,T), if we let P(- ,t) be the solution of (1.16) with t replaced by r, then 



J(T,X*(T;i,a;);u(-)) 



p(s,T)|7.(s)pds + .g(r)|X(P)| 



where 



Consequently, by denoting 



= P(r,T)X*(T;i,.T)2+E, / p(.s,T)\u{s) + ^^X{sfds, 



X{-)=X{-;T,X*{T;t,x),u{-)), u{-)eU[T,T]. 



X*i-) = Xi;;T,X*iT;t,x),u*i-)\^^^^^), 



we have 

JiT,X*{T;t;x);u*{-)\ ) ^ P{T,T)X*iT;t,xf +Er f pis,r)\u*{s;t,x) + ^^X*{s)\^ds 

(1.19) '' ' Jr P[s,t) 

>P(T,T)X*{T;t,xf = inf J(t, X*(t; t, x), u(-)) = J(t, X*(t; t, x), u*(- ; r, X*(t; t, x))), 

•u(-)6'2r[r,T] 

and the incquahty actually becomes an equahty if and only if 

^20) ,u{s-t,x) = u*{s\T,X*{T]t,x)), seWT] 

X*{s;t,x) = X*{s;T,X*{T;t,x)), 

Similar to (1.17), we should also have 

(1.21) u*{s;T,X*{T;t,x)) = -^^X*is;T,X*iT;t,x)), s (1 [t,TI 

Combining (1.17) and (1.20)-(1.21), we obtain 

(1-22) —, ^ = , , , yt < T < s < T. 

p{s,t) p(s,t) 

In particular, evaluating at s = T, one has 

9ir) _ git) 



piT,T) p{T,t)- 

This means that if f i— > -jjA) is not a constant function, then a strict inequality in (1.19) will hold for some 
T G {t,T], which means that the restriction u*(-)L „, of the optimal control u*{-) (for the initial pair {t,x)) 
is not optimal on [t,T] with initial pair (t, X*(t; t, a;)) £ '3. Such a feature is called time-inconsistency of 
the problem. 

Next example exhibits a different situation. 

Example 1.2. Consider state equation (1.14) with cost functional 

(1.23) J{t,x;ui-))=Et[f \uis)\^ds+\Et[XiT)]\^ 

Note that in the above, Et[X(T)] is nonlinearly appeared, which is non-classical. To solve the corresponding 
LQ problem, let us introduce the following Riccati equation: 

P(s) - P(,s)2 = 0, se[0,T], 

P{T) = 1, 

whose solution is given by 

For any given (i,x) G & and u{-) G ^[t,T], let X{-) = X{- ;i,a;,-u(-)) be the corresponding state process. 
Then 

dEt[X{s)] ^Et[u{s)]ds, s e [t,T], 

Et[X{t)]^x. 



Observe the following: 

Jit,x; ui-)) - Et [ / \u{s)\^ds + P{T)\Et[X{T)]\ 

= P(0)|xp+Et /" (^\u{s)f + Pisf\Et[Xis)]\^ + 2Pis)Et[X{s)]uis)]ds 
= P{0)\xf+Et / \u{s) + P{s)Et[X{s)]\^ds > P{0)\x\^, 

with the equality holds when 

u*{s) = -P{s)Et[X*{s)], sG[i,T], 

where X*{-) is the solution to the following elosed-loop system: 

dX*{s) = -P{s)Et[X*{s)]ds + X*{s)dW{s), sG [f,T], 

X*{t)=:X. 

Such an equation is called a mean-field SDE. The above yields 

d{Et[X*{s)]) = -P{s)Et[Xis)]ds, s e [t,T], 

^Et[X*{t)]^x. 

Consequently, 

Et[X*{s)] = e-^^' ^W'"-a; = e- ^^ ^^^x = ^^"rf^^, s £ [t,T]. 

Then 

u*{s) EE ti*(5;t,a;) = -P(s)E4X*(5)] - -^73^ , ■? e [t,T]. 

Note that u*(-) stays as a constant on [t, T], with (t, x) as a parameter. With such a control, the closed-loop 
system reads 

' dX*{s) = - r^_]^^ ds + X*is)dWis), s e [i,r], 

X*(i) = a;, 
whose solution is given explicitly by the following: 

-^ ^ ^ ^ Jt 
Consequently, for any r G (^,7"], the optimal control starting from (r, X*(r)) should be 

u*{s-r,x*{T)) = - J^*^^] .e[T,r], 

J — T + i 

which is J>-ineasurable, and is not J-i-measurable for any t < t, whereas u*(s; t, x) is merely J^t-measurable, 
with t < T. Hence, 

u*{s;t,X*{t)) = u*{s;t,x), s € [t,T], a.s. , 

cannot be true. This implies that the problem associated with (1.14) and (1.23) is time-inconsistent. 

The above two examples present two different situations for which the associated problems are time- 
inconsistent. In the first example, the time-inconsistency is due to the fact that the discounting is non- 
exponential, and in the second example, the time-inconsistency is due to the appearance of the conditional 
expectation of the state in a nonlinear way. The non-exponential discounting situation has been discussed 
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in [8, 10, 9, 25, 26, 27, 19]. The main motivation of that is trying to catch people's subjective preferences 
on the discounting (see [23, 22, 11, 21, 24, 17, 15, 6, 13, 12, 20]). The case with nonhnear appearance of 
conditional expectation in the terminal cost of the cost functional has been studied in [2, 3, 14]. A main 
motivation of that is a kind of conditional/dynamic mean- variance problem (see [1, 4]) See also [5, 16, 7] for 
relevant results. On the other hand, in [28], an LQ problem for mean-field SDEs in a fixed time-duration was 
investigated (without mentioning the time-inconsistency), for which a motivation is from optimal control 
theory point of view: People might like to have the optimal control, as well as the optimal state, to be 
not too "random". To achieve that, one could include conditional variation var([X(s)] of the state process 
and/or conditional variation vart[M(s)] of the control process in the cost functional, where 

vaYt[X{s)] = Et\X{s)^Et[X{s)]\^ =. Kt\X{s)\^ - \Et[X{s)]\\ 
vart[u(s)] = Et\u{s) - Eju(s)]f = Et\u{s)\^ - \Et[u{s)]\\ 

Then Et[X(s)] and Et['u(s)] naturally appear quadratically. 

The purpose of this paper is to study a general linear quadratic optimal control problem for mean-field 
stochastic differential equations (MF-SDEs, for short), which include the cases of non-exponential discounting 
and conditional mean-variance problems. We point out that the problem can be stated for MF-SDEs with 
random coefficients. However, at the moment, we only have a relatively complete theory for deterministic 
coefficient case. Therefore, for the definiteness of the presentation, we restrict ourselves to the deterministic 
coefficients. A theory for general random coefficient case will be reported in a future publication. 

The rest of the paper is organized as follows. Section 2 will collect some basic preliminary results. In 
Section 3, wc formulate our linear-quadratic optimal control problem for mean-field SDEs (MF-LQ problem 
for short), and the so-called pre-commitment solution to such a problem (which is a result from [28]). In 
Section 4, we introduce open-loop and closed-loop time-consistent solutions to our MF-LQ problem. We 
derive the Riccati equation system for open-loop equilibrium solution by means of variational method and 
decoupling a forward-backward stochastic differential equation (FBSDE, for short). We show that as long as 
the Riccati equation system has a solution, the open-loop equilibrium control can be constructed. It turns 
out that the Riccati equation system for open-loop equilibrium solution does not have a desired symmetric 
structure. Therefore, it seems to be difficult to establish the well-posedness for such a system in general. 
Further, in this section, we state the main result of the paper: the existence of closed- loop equilibrium solution 
via a Riccati equation system which has a symmetric structure. Some interesting special cases are indicated. 
In Section 5, a multi-person differential game is introduced from which we find a kind of approximate time- 
consistent strategy. Convergence of the approximate time-consistent strategy is established in Section 6, 
which leads to the Riccati equation system and its wcU-poscdness. 

2 Preliminaries. 

In this section, we present some preliminary results which will be useful in the following sections. Let us 
first introduce some notations. For any < < < T, let 

^t = {^ : rj -> M" I ^ is J"(-mcasurable, Et|^p < oo}, 



^' 



[t,T] = (a: : [f,T] X f7 ^ M" I X{-) is E-adapted, t ^ X{t) is continuous, Ej [ sup \X{s)\ 



se[t,T] 



< oo 



For any Euclidean space H ~ R",R"^'",S" (where §" is the set of all {n x n) symmetric matrices), we let 



C([i,r];iJ) ^ {ip:[t,T]^ H\ ip[-) is continuous}, 

C^([i,r];i7) = {Lp:[t,T]^ H\ ip{-),^{-) are continuous}, 

L°°{t,T;H)^{^: [t,T]^H\ |I^(-)||oo = csssup |(^(s)| < oo}. 

se[t,T] 

Now, we consider the following linear mean-field SDE (MF-SDE, for short): 

\ dX{s)^\A[s)X{s)+A{s)¥.t[X[s)] + b{s)]ds+\c[s)X{s)+C[s)¥.t[X{s)]+a{s)]dW{s), sG[t,T], 
(2.1) < L J L J 

I X{t) = X, 

with suitable coefficients ^(•), ^(•),C(-),C(-), and nonhomogcneous terms &(-),cr(-), as well as the initial pair 
{t,x) G &. We refer to {A{-),A{-),C{-),C{-)} as the generator oiihc linear MF-SDE (2.1). 

The following result is concerned with the well-posedness of (2.1). 

Proposition 2.1. Let A{-),A{-),C {■),€{■) be in L°°(Q,T;W''"'). Then for any {t,x) e ^ and 6(-), cr(-) G 
L^(0,T;M"), MF-SDE (2.1) admits a unique solution X{-) G .^[t,T]. Moreover, the following variation of 
constants formula holds: 

X{s) = *(s, i){[/+ / *(r, t)-\A{r)~C{r)C{r))^{r, t)dr+ f *(r, t)-^C{r)^{r, t)dW{r)] x 



(2.2) 



+ ^{r,t)-^ b{r) + (A{r)^C{r)C{r)) ^{r,t)Et[b{T)]dT ~ C{r)a{r) 



dr 



+ I *(r,t)-i C{r) I $(r,T)Et[6(r)]dr + cr(r) dW^(r)|, sG [t,r], 



where $(•,•) is the fundamental matrix of A{-)+ A{-), and *(•,•) is the fundamental matrix of {^(•),C(-)}, 



j.e., 

(2.3) 
and 

(2.4) 



$(s, t) = [^(s) + ^(s)] #(s, i), s e [i, T], 

$(t,i)=/, 

d4'(s, i) === ^(s)*(.s, i)ds + C{s)^{s, t)dW{s), s G [i, T], 

M/(i,t)-/. 



Proof. First, we introduce the following linear ordinary differential equation (ODE, for short): 

^2 5) {dX{s) = {[A{s)+A{s)\X{s)+¥.t[b{s)]]ds, sG[t,r], 

whose solution is given by 

X{s) = $(s,t)2;+ / l>(s,r)Ef[6(r)]dr, s G [t,T], 

where $(• , •) is the fundamental matrix of ^(•)+^(-) (which is deterministic). Then we consider the following 
linear non-homogeneous SDE: 

dX{s)^\A{s)X{s)+A{s)X{s) + b{s)\ds+\c{s)X{s)+C{s)X{s) + a{s)\dW{s), sG[i,T], 
X{t) = X, 



It is standard that the above admits a unique solution X{-) = X(- ;t,x,b{-),a{-)) £ ^[t,T]. Clearly, for 
such a solution, one has 

Et[X{s)]^X{s), se[t,T]. 

Hence, X{-) is the unique solution to (2.1). The rest of the conclusion follows easily. □ 

It is known that if X{- ; t, x) is the solution to the following SDE: 



(2.6) 



dXis)= Ais)X{s) + b(s) ds+ C{s)X{s) + a{s) dW{s), se[t,T], 
X{t) = X, 

for any given (i, x) 6 &, then 

(2.7) X{s;T,X{T;t,x))^X{s;t,x), t<T<s<T. 

In another word, the map r i— > (r, X(r;i,x)) has the so-called semigroup property. Whereas, we point out 
that this is not necessarily the case for MF-SDEs, in general. Here is a simple example. 



Example 2.2. Consider 



Then 



which leads to 



dX(s) =Et[X(s)]ds + Et[X{s)]dW{s), s £ [t,T], 

X{t) = X. 

dEt[X{s)] = Et[X{s)]ds, s e [t,r], 
Et[X{s)]=e''-^x, se[t,T]. 



Hence, the original equation becomes 



dX{s) ^ e'-^xds + e'~*xdW{s), s e [t, T], 

X{t) ^ x. 



Then one has 



X{s;t,x)= 1+ e''-'dr+ e'-'dW^r) 



e--t+ I e'-'dWir) 



e[t,T]. 



Now, for any t < t < s, we have 

X{s;T,X{T;t,x))^ e""^ + / e'-^diy(r) X{T;t,x) 

= e'-^ + [ e'-'^dWir)] [e^^* + / e'-'dWir) 

f-'dWir) + I e'-^+'-'dWir) +( I e'-^dWir)) ( I e''-*diy(r)) 



Hence, 



X( 



{s;T,X{T;t,x))-X{s;t,x)^ e'-^ + f e'-^dWir) (f e''-'dW{r))x 



Consequently, as long as a: 7^ 0, 

Et\X{s;T,X{T;t,x)) ~X{s;t,x)f ^Et^Er 



e/-^ + / e'^-^dWir) 



*dVK(r)) }: 



s2(---) + f e2(r-r)^^j ^ f e^C'-*)^^)^^ > 



This shows that (2.7) fails in general. 

The following result will be useful later. 
Proposition 2.3. Let 



(2.8) 

Suppose that for some d > 0, 

(2.9) 



A{-),Ci-) e L°°(<,r;M"), Bi-),v{-),Si-f e L°°(i,r;M"^"), 

Q(-) ei°°(t,T;§"), 7^(•) eL°°(i,r;S"), 5 G §". 



7^(s)>(5/, Q{s)-S{sfTZ{s)-^S{s)>Q, s e [t,T], 

g>o. 



Then the following Riccati equation admits a unique solution P(-) G C^([i,r];S"); 



(2.10) 

Further, 
(2.11) 



P{s) + Pis)A{s) + A{sfP{s) + CisfP{s)C{s) + Q{s) 

- [P{s)B{s) + Sisf + C{sfP{s)V{s)] [7^(s) + V{sfP{s)V{s)] "' 
■[BisfPis)+S{s) + VisfP{s)C{s)] =0, s&[t,T], 

p{T) = g, 

[TZ{s)+V{sfP{s)V{s) >0. 



< P{s) < n(s) < Kol, s G [t, T], 



wiere n(-) G C^([0, T]; §") is tie unique solution to the following Lyapunov equation 

(2.12) 

and 



tl{s) + U{s)Ais) + Aisfnis) + Cisfll{s)C{s) + Q{s) =0, s G [t, T], 

n(T) ^ g, 



A'n = 



(|a|+T||Q(. 



,TM(.)+^(-)^+c{-)^c{-: 



Proof. For any (r, x) G [t,r) x M", we introduce the following controlled SDE: 



(2.13) 



dX{s)= A{s)X{s)+Bis)uis) ds+ C{s)X{s) + V{s)u{s) dWis), sG[r,T], 



X{r) ^ X 
with cost functional 

i-T 



J{r,x;u{-))^E[ (^{Q{s)X{s),X{s))+2 {S{s)X{s),u{s)) + {TZ{s)u{s),u{s))ys + {gX{T),X{T)] 
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From [29], we know that under our conditions (2.9), the associated LQ problem admits a unique optimal 
control u*{-) which has the following state feedback representation: 

u*{s) = -e{s)X*{s), se[r,T], 

with &{■) given by 

(2.14) e(s) = [TZis) + VisfP{s)Vis)] "' [BisfPis) + 5(s) + V{sfP{s)Cis)] , s e [t,T]. 

and X*{-) is the solution to the following closed- loop system: 

i dX*{s) ^ [A{s)-B{s)e{s)]X*{s)ds+[C{s)-V{s)e{s)]X*{s)dW{s), se[r,r], 
\x*{r)^x. 

Here, P(-) is the unique solution to the Riccati equation (2.10). Moreover, 

< ( PMx, x) ^ inf J(r, x; u(-)) = Jir, x; u*{-)) 
(2.16) ''' 

< J(r, a;; 0)=e[/ {Q{s)X\s),X\s)) ds + {gX\T),X\T)) 

where X^{-) is the solution to (2.13) with u{-) = 0, i.e., 

dX°{s) = A{s)X°{s)ds + C{s)X°{s)dW{s), s e [r, T], 

X°(r) = X. 

On the other hand, since n(-) is the solution to (2.12), applying Ito's formula to ( n(-)X"(-), X'^{-) ), we have 
{U{r)x,x) =E[(n(T)X"(T),X"(T)) 



(2.17) 



(2.18) 



E 



[n{s) + n{s)A{s)+A{sfU{s)+C{s)^U{s)C{s)]X°{s),X'>{s))ds 



{ gX"{T),X^{T) )+ ( Qis)X"is),X^{s) ) ds 



= J(r,.T;0) > {P{r)x,x) . 
Next, applying Ito's formula to |X*'(-)p, one has 

E|X°(s)|2 = \x\^ + E /"' ( [A{t) + Airf + C{TfC{T)] X"(t), X°{t) ) dr 

J r 

<\xf + \\Ai-)+Ai-f+Ci-fCi-)\\o. fnx\r)\^dr. 

J r 

Then, by Gronwall's inequality, together with (2.16) and (2.18), we obtain 

< P{r) < n(r) < KqI, r e [t, T]. 

This completes the proof. 

Note that with the function &{■) defined by (2.14), Riccati equation (2.10) can be written as 

P{s) + P{s) [Ais) - 6(s)e(s)] + [A{s) - Bis)eis)f Pis) + Q{s) 

(2-19) <! +[c(.5)-p(s)e(s)]^p(s)[c(s)-p(s)e(s)] -0, se[t,r], 

p{T) = g. 
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If 0(-) is given, the above can be regarded as a Lyapunov equation for P(-). The following lemma will play 
an interesting role in our later investigations. 



Lemma 2.4. Let 



(2.20) 



Q(-),Q(-),Q(-)eL°°(t,T;S"), g,ge§". 



Then there are r(-), r(-) and T{-) uniquely solve the following three Lyapunov equations: 

r(s) + f{s)A{s) + A{sff{s) + C{sff{s)Cis) + Q{s) =0, se [t, T], 



(2.21) 



r(r) = g, 



(2.22) 



f (s) + T{s)[A{s) + A{s)] + [A{s) + A{s)fT{s) 

+ [Cis)+C{s)ff{s)[Cis)+C{s)] + Q{s) + Q{s) = 0, se [t,T], 

r(T) = g, 



and 
(2.23) 



f (s) + f (s)[^(s) + A{s)] + [A{s) + A{s)ft{s) + Q{s) =0, se [t,T], 

f (T) = g. 

Let {t,x) e & and X{-) = X{-;t,x) be the solution to (2.1) with b{-) = a{-) = 0. Then for any t e [0,t], 



Er 



(2.24) 

Further, if 

(2.25) 

then 
(2.26) 



{Q{s)Xis),X{s)) + {Q{s)Et[X{s)iEt[Xis)]) + {Q{s)Er[Xis)iEr[X{s)]))ds 
+ {gXiT),X{T)) + {gEr[X{T)lEr[XiT)]) 

Er [ ( T{t)x, x)]+{ f{t)Er[xlEr [x] ) . 



Q{s), Q{s) + Q(s), Q{s) + Q(s) + Q{s) > 0, se [0, T], 

g, g + g>o, 



r(s), r(s), r(s) + f(s) >o, se[o,T]. 



Note that in the left hand side of (2.24), the conditional expectation terms Ei[^(s)], Et-[X(s)] and 
ET-[X(r)] (with < r < t) appear quadratically (not linearly). It turns out that one can represent them in 
terms of x and Er[x] by using r(-) and f (•) (which also involves r(-) indirectly). 

Proof. First of all, since Lyapunov equations are linear, under our conditions, r(-), r(-), and r(-) 
uniquely exist. Note that for < r < t < T, and x e ^t-, let X(-) = X(- ;t,a;) be the solution (2.1) with 
K-) = o-(-) = 0. We have 

d(E^[X(s)]) = {A{s) + A{s)\Er{X{^s)\ds, se {t,T\ 

Er\X{t)\ =Er\x\ 
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d{Et[X{s)]-Er[X{s)]) = [A{s)+A{s)]{Et[X{s)]^Er[X{s)])ds, se[t,T], 
^Et[X{t)]-Er[Xit)]^x-Er[x], 
and 

d{X{s)-Et[X{s)]) ^ Ais){X{s) ~Et[X{s)])ds + \c{s)X{s) + C{s)Et[X{s)]\dW{s), sG [t,T], 
X{t)~Et[Xit)]=0. 

Denote r(-) = r(-)+f(-). Then f (•) satisfies the following: 



(2.27) 



f(s) + f{s)[A{s) + A{s)] + [A{s) + A{s)ff{s) 

+ [C{s) + C{s)ff{s)[C{s) + C{s)] + Q{s) + Q{s) + Q{s) = 0, s £ [i, T], 

fiT) = g + g, 

By Ito's formula, we have 



Er 



; gX{T), X(T) ) + ( gEr[X{T%Er[X{T)] ) 



Er y{g[X{T)- Et [X{T)]), X{T) - Et [X{T)] ) 

+ {g(Et[X{T)] - Er[X{T)]),Et[X{T)] - Er[X(T)] ) + {{g + g)Er[X(T)],Er[X(T)] ) 



= E^ 



E, 



{T{T){X{T) -Et[X{T)]),X{T) -Et[X{T)]) 
+ {riT){Et[X{T)] -Er[X{T)]),Et[X{T)] -Er[X{T)]) + {f{T)Er[XiT)],Er[X{T)]) 
{ r(<) {x -Er[x]),x-Er [x] ) + ( f (t)E^ [x] , E^ [x] ) 



-E^ 



{{T + TA+A^T){X-Et[X]),X-Et[X]) + {T{CX+CEt[X]),CX+CEt[X]) 



{ [t + T{A + A) + {A + Afr] {Et[X] - Er[X]),Et[X] - Er[X] ) 



+ ( {r + f(^ + ^) + (^ + Af f}Er[X],Er[X] ) 



ds 



--E., 



; T{t)x, x ) + ( r(i)E^ [x] , E^ [a;] ) 



-E^ 



{{r+rA+A^r+c'^rc){x-Et[x]),x-Et[x]) 
+ ( [f + r(^ + ^) + (^ + ^)^r + {c + cff{c + c)] {Et[x] - Er[x]),Et[x] - e^[x] ) 

+ {{f + f{A + A) + {A + Aff + {C + Cff{C + C)}Er [X] ,E^ [X] ) ds. 
On the other hand, 



E^ 



E^ 



QX,X) + { QEt[X],Et[X] ) + { QEr[X],Er[X] ) Jds 

T _ 

( Q{X - Et\X]),X- Et[X] ) + {{Q+ Q){Et[X] - Er[X]),Et[X] - E,[X] } 
^{{Q+Q+Q)TEr[X],Er[X])]ds. 
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Hence, 



E^ 



E^ 



{QX,X) + {QEt[X],Et[X] ) + ( QEr[X],Er[X] ) )ds 
+ (gXiT),X{T)) + {mr[X{T)],Er[X{T)]) 

{r{t)x,x)] + {f{t)Er[x],Er[x]) 



((r + r^ + ^"^r + c^rc + Q){x - Er[x]),x- Er[x] ) 

■{[t+r{A+A) + {A+Afr + {C+Cff{C+C) + Q+Q\{Et[X]-Er[X]),Et[X]-Er[X]) 



+ ( {r + r(^ + ^) + (^ + ^)^r + (c + cff{c + c) + q + q + Q}Er[x],Er[x] ) 

= E^ [ ( r{t)x, x)]+{ t{t)Er [x] , E^ [x] ) . 
This proves (2.24). Finally, if (2.25) hold, by Proposition 2.3, we obtain (2.18). 



ds 



3 Linear-Quadratic Optimal Control Problem for MF-SDEs 

We now consider the following controlled linear MF-SDE: 

dX{s) = iA{s)X{s) + A{s)Et[X{s)] + B{s)u{s) + B{s)Et[u(s)]\ds 



(3.1) 



+ \^C{s)X{s) + C{s)Et[X{s)]+D{s)u{s)+D{s)Et[u{s)]yW{s), s G [t,T], 
X{t) = x g jTt, 



Note that for any {t, x) £ ^ and u(-) e "^[t, T], the corresponding state process X{-) ^X{- ; i, x, u{-)) depends 
on {t,x,u{-)). The cost functional is as follows: 



J{t,x;ui-)) =Et 



(3.2) 



[Qis,t)Xis),Xis)) + {Q{s,t)Et[X{s)lEt[Xis)]) 



ds 



+ {R{s,t)u{s),u{s) ) + {R{s,t)Et[u{s)],Et[u{s)] ) 
+ { G{t)X{T), X{T)) + { Omt [X(T)] , Et[X{T)] ) } 

Let us introduce the following hypotheses: 
(HI) The following hold: 



(3.3) 



A(.),i(-),c(-),c(-)eC([o,r];R"><"), 

B{-),B{-),D{-),D{-) G C([0,T];R"^™). 



(H2) The following hold: 

^3 4^ fQ(-,-),Q(-,-)GC([0,T]2;§"), i?(.,.),i^(.,.)eC'([0,T]2;S'"), 

\G(-),G(-)eC([0,r];S"), 

and for some S > 0, 

Q{s,t), Q{s,t) + Q{s,t)>0, R{s,t), R{s,t) + R{s,t)>61, 0<t<s<T, 



(3.5) 



G{t), G{t) + G{t) > 0, < t < T. 
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(H3) The following monotonicity conditions are satisfied: 

Q(s, t) < Q{s, r), Q{s, t) + Q(s, t) < Q{s, r) + Q(s, r), 

(3.6) \ R{s,t)<R{s,T), R{s,t) + R{s,t)<R{s,T) + R{s,T), < t < r < s < T. 
G{t)<G{T), G{t) + G{t)<G{T) + G{T), 

It is clear that under (H1)-(H2), for any {t,x) £ & and u{-) e ^[t,T], state equation (3.1) admits a 
unique solution X{-) = X{- ; t, a;, «(•)), and the cost functional J(t, x; w(-)) is well-defined. Then we can state 
the following problem. 

Problem (MF-LQ). For any {t,x) G ^, find a u*{-) £ ^[t,T] such that 

(3.7) J (t,x;u* (■))== inf J(t,x]u(-)) =Vit,x). 

For given {t,x) € &, any «*(•) G ^[i, T] satisfying the above is called a pre- commitment optim,al control for 
Problem (MF-LQ) at (t, x). The corresponding X*(-) and (X*(-),u*(-)) are called pre- commitment optimal 
state process and pre- commitment optimal pair of Problem (MF-LQ). respectively, and V{- , •) is called the 
pre- commitment value function. 

In the case that 

(3.8) A{s) = C{s) = Q, B{s)^ D{s)^0, se[0,T], 
and 

(3.9) Q(s,<) = 0, Ris,t)^0, G{t)^0, < t < s < T, 

Problem (MF-LQ) is reduced to the problem studied in [25], which is an LQ problem with purely general 
(possibly non-exponential) discounting. In addition, if 

(3.10) Q{s, t) = Q{s), R{s, t) = R{s), G{t) = G, < f < s < T, 

then Problem (MF-LQ) is further reduced to a classical LQ problem for SDEs with deterministic coefficients 
(see [29] for details). In the case that (3.8) and (3.10) hold, and 

(3.11) Q{s, t) = 0, R{s, t) = 0, G{t) = G, 0<t<T, 

Problem (MF-LQ) is a case of those studied in [14] where the problem was investigated by means of variational 
method together with forward-backward SDEs and the time-consistent solution studied is of open-loop type 
(see the next section for further details). 

We also point out that if 

Q{s,t) = Q(s)e-^(^-*), Q{s,t) - g-^t^"*), 
R{s,t)^R{s)e-^'^'-'\ R{s,t) = e-^^'-*\ 0<t<s<T, 

Git) = Ge-^(^-*) , G{t)^ Ge-^(^-*) , 

with A > 0, and with 

Q{s),Q{s) + Q(s)>0, R{s),R{s) + R{s)>0, se[0,T], 
G,G + G>0, 
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then monotonicity condition (H3) holds. Hypothesis (H3) wih be used later. 
In what follows, we will denote 



(3.12) 



A{s) = A{s) + A{s), B{s) = B{s) + B{s), 

dis) = C{s) + Cis), D{s) = D{s) + D{s), 

Q{s, t) = Q{s, t) + Q{s, t), R{s, t) = R{s, t) + R{s, t), 
G{t)^G{t) + G{t). 



0<t< s<T. 



Wc now recall a result from [28] for the pre-commitment solution of Problem (MF-LQ). 

Proposition 3.1. Let (H1)-(H2) hold. Then for any fixed t e [0,r), the following Riccati equation 
system admits a unique solution (P(-),P(-)) 6 C^{[t,T];S'^)'^ (suppressing s): 



(3.13) 



P + PA + A^P + C^PC + Q{t) - {PB + C^PD) [R{t) + D^ PD] \b'^P + D'^ PC) = 0, 
P + PA + A^P + C'^PC + Q{t) - {PB + C'^PD) [R{t) + D'^ PD] '\b^P + D^PC) = 0, 

se[t,T], 
[P{T)=G{t), P{T) = G{t). 

Further, let x G ^t and X*{-) = X*{- ;t,x) be the solution to the following closed-loop system: 



dX 



(3.14) <^ 



with 



\s)^{[A{s)-B{s)e{s)]X*{s)+[A{s) + B{s)[e{s)~Q{s)]-B{s)Q{s)\Et[X*{s)]ys 
+ {[C(s)-i?(s)e(s)]X*(s)+[c(s)+i?(s)[e(s)-e(s)]-5(s)e(s)]Et[X*(s)]}dl^(s), s&[t,T], 
X*{t) ==a;, 



(3.15) 



e(s) = [R{s, t) + D{sfP{s)D{s)] [B{sfP{s) + D{sf P{s)C{s)] , 
Q{s) = [R{s, t) + D{sf P{s)D{s)\ "' [B{sfP{s) + D{sf P{s)C{s)\ , 

and define u*{-) as follows: 

(3.16) w*(s) = -e(s)X*(s)+[e(s)-e(s)]Et[X*(s)], se[t,T]. 

Then (X*{-),u*{-)) is the pre-commitment optimal pair of Problem (MF-LQ) at {t,x), and 



^[t,n 



(3.17) 



V{t,x)= inf J(t,x;u{-)) ^ J(t,x;u*{-]] = {P(t)x,x), Va; G JT^. 
u{-)euit,T] 



We point out that system (3.13) is decoupled. With &{■) and 6(-) given by (3.15), we can write (3.13) 
as follows: 



P{s) + Pis) A{s) - B{s)e{s) + A{s) - B{s)e{s) P{s) + Q{s, t) 



(3.18) 



C{s) - D{s)Q{s) 



P(s] 



G{s) - D{s)e{s) + e(s)^i?(.s, i)e(s) = o, 

T ^ ^ 



Pis) + P{s) [A(s) - B(s)e(s)J + [A(s) - B(s)e(s)J Pis) + Qis) 

+ \dis) - i5(s)e(s)j Pis) \dis) - i5(s)e(s)j + e(s)'^^(s, t)e(s) = o, s e [t, r], 

[ PiT) = Git), PiT) = Git). 
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Next, we note that in the case 

A(.)=C(.)=0, B{-)^D{-)=0, 
the conditional expectation terms are aU absent in the state equation, and 



(3.19) 



e(s) = [R{s, t) + D{sfP{s)D{s)\ [B{sfP{s) + D{sY P{s)C{s)\ , 
%{s) = [R{s, t) + D{sfP{s)D{s)\ "' [B{sfP{s) + D{sf P{s)C{s)\ , 



s6[t,T] 



In this case, the equation for P(-) becomes 



(3.20) 



P(s) + P{s)A{s) + A{sYP + C(s)^P(s)C(s) + Q(i, s) 

- [P(s)B(s) + C{sfP{s)D{s)\ [i?(s, i) + D{sfP{s)D{s)\ '' 

■ [B{sfP{s) + D{sfP{s)C{s)] - 0, s<E [i, T], 

[P(T) = G(i), 



We see that as long as 



are not true, 



0(-,-) = o, 



Ri- 



0, 



G(.)=0 



e(s) = e(s). 



e[t,T] 



is not true in general. Hence, the term ¥,t[X*{-)] will present in the state feedback representation of u*{- 
(see (3.16)), and the closed-loop system reads 



(3.21) 



dX 



■■{s)^{[A{s)-B{s)Q{s)]X*{s) + B{s)[e{s)~Q{s)]Et[X*{s)]}ds 

+ {[Cis)-Dis)e{s)]X*{s)+D{s)[eis)-Q{s)]Et[X*{s)]yWis), se[t,T] 
X*{t)=x, 



which is a linear MF-SDE. The above shows that even if the original state equation does not contain the 
conditional expectation terms, as long as some conditional expectation terms appear in the cost functional, 
the closed-loop system for the pre-committed solution of the problem will still be an MF-SDE. This is why 
we start with a controlled MF-SDE. 

We now present the following result which is relevant to the Riccati equation system (3.13). 

Proposition 3.2. Let (H1)-(H2) hold. For a fixed t £ [0,T), let {P{-),P{-)) be the solution to the 
Riccati equation system (3.13), let !!(•) and n(-) be the solutions to the following Lyapunov equations: 

se [t,T], 



(3.22) 

and 

(3.23) 

Then 
(3.24) 



ri(.s) + U{s)A{s) + A{sfU{s) + C{sfU{s)C{s) + Q{s, t) = 0, 

n(T) = G(t), 



I n(s) + n(s)l(s) + A{sffi{s) + d{sfu{s)d{s) + q{s, t) = o, 
[ n(T) - Git). 



se [t,T], 



o<P(s)<n(s), se[t,T], 
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and 
(3.25) 



o<P(s)<n(s), se[t,T]. 



Proof. Fix t G [0,T). Applying Proposition 2.3 with 

^(s) = ^(s), S(.s) = B(.s), C(.s)=C(s), P(s)=i:>(s), t<s<T, 
Q{s) = g(s, i), 5(s) = 0, n{s) = i?(s, i), g = G{t), t<s<T, 

we obtain (3.24). Next, we let 

A{s)^Ais), B{s)^B{s), C{s) = C{s), V{s)^D{s), 
Q{s) = Q(s, t) + C(s)^P(5)C(s), 5(s) = VisfP{s)C{s), 

nois) = R{s,t), nis)^nois) + v{sfp{s)vis), g = G{t). 



Then the equation for P(-) can be written as 
(3.26) 



P(s) + P{s)A{s) + y^(s)^P(s) + Q{s) 

^[P{s)B{s) + S{sf]n{s)-^[B{s)P{s)+S{s)\=Q, se [i,r], 

I ^(T) = g, 



which is the Riccati equation for the deterministic LQ problem with the state equation 

X{s)^A{s)X{s)^B{s)u{s), s(^[r,T], 
^ X{r) = X, 

and the cost functional 

J(r, X- ui-)) - / ( ( S(s)X(s), Xis) ) +2 (>S(s)X(5), w(s) ) + (7^(s)^^(s), u(s) ))ds+{ gX{T), X{T) ) . 
We now look at the following: (suppressing s) 



-l-nTi 



Q-s' n^'s >c' PC- C PV{no + v pvyv pc 



= c^p-2 
= c^p-^ 

In the above, we have denoted 
and used the fact 



/ - P2^>(7^o + 'D PV)-'V' P 



P^C 

/-ptp7^o'(^/+7^o'2?'p*ptP7^o"^') n^^v'^p 

/- A(/+A^A)-iA^l P-^C = C^P5(/+AA^-ip^C > 0, 



K^P'-vn^ ^ 



P3C 



/ - A(/ + A^A)-iA^ = (/ + AA^)-i. 
Then by Proposition 2.3 with C(-) — and V{) = 0, we have 

P{s)<P\s), s6[f,r]. 
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where P^{-) is the solution to the foUowing Lyapunov equation: 

Next, by the proved (3.24), we see that 

Q{s) = Q{s, t) + C{sfP{s)C{s) < Q(s, t) + C(s)^n(s)C(s). 
Thus, by Proposition 2.3 again, we obtain 

pO(s) < P°(s), 
with P°(-) being the solution to the following Lyapunov equation: (note .4(-) = A{-), C(-) = C'(-), and 

g = Git)) 

( P0(.s) + pO(s)A(s) + A{s)^P"{s) + d{s)^U{s)d{s) + Q{s, t) =0, s e [t, T], 

\p°{T)=G{t). 

Comparing with (3.23), by uniqueness, we obtain 

p°(.) = n(-). 

This completes the proof. □ 

4 Time- Consistent Equilibrium Solutions. 

From Examples 1.1 and 1.2, we see that in general. Problem (MF-LQ) is time-inconsistent. Our goal is to 
find time-consistent (equilibrium) solutions to Problem (MF-LQ). 

4.1 Open-loop equilibrium control. 

In this subsection, we consider the case that 

(4.1) A(.)=C(.)=0, P(.) = ^(-)=0, 

Thus, the state equation reads as (1.1). However, we still consider cost functional (3.2) in which all the 
conditional expectation terms appear, and all the weighting matrices depend on (s,<). Note that in [14], 
the state equation is similar to ours (with additional nonhomogeneous terms, which do not bring additional 
essential difficulties) and the cost functional has the only conditional expectation appeared at the terminal 
cost, and all the weighting matrices are independent of t (the initial time). Therefore, in some sense, the 
case of this subsection can be regarded as an extension of relevant cases appeared in [14]. Similar to [14], we 
introduce the following notion. 

Definition 4.1. For given x e R", a state-control pair {X* {■) , u* {■)) G jr[0,T] x ^[0,T] is called an 
open-loop equilibrium pair of Problem (MF-LQ) for the initial state x if 

X*{Q) =a;. 
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Ij^ J{t,X*{t);u-{-))-J{t,X*ity,u*i-)) ^ ^^ 



and for almost all i £ [0, T), and any m(-) € '^[t, T], 

(4.2) 

where 

(4.3) «n-)-«(-)^[M+e)(-)+"*(-K[*+.,T](-)- 

In this case, ^*(-) and u*{-) are called an open-loop equilibrium state process and an open-loop equilibrium 
control, respectively. 

We refer to (4.2) as a local optimality condition at i G [0,T). One sees that if (X*(-), u*(-)) is an open- 
loop equilibrium pair of Problem (MF-LQ) for the initial state x, then along the open-loop equilibrium state 
X*(-), the open-loop equilibrium control u*{-) stays locally optimal. On the other hand, since {X*{-),u*{-)) 
is a fixed state-control pair of (1.1) on [0, T], in which the conditional expectation terms arc absent, the above 
defined open-loop equilibrium pair is time-consistent. Note that if we consider the general state equation 
(3.1) in which some conditional expectation terms appear, we do not know if one can directly define time- 
consistent state-control pairs. This is why for open- loop equilibrium solutions of Problem (MF-LQ), we only 
consider (1.1). The following result, in some sense, is an extension of a relevant result found in [14]. 

Proposition 4.2. Let (H1)-(H2) and (4.1) hold. Suppose {X*{-),u*{-)) e ^[0,T] x ^[0,T] is a state- 
control pair starting from initial state x. For each t g [0, T), let {Y{- , t), Z{- , t)) he the adapted solution of 
the following BSDE: 



(4.4) 



dY{s, t) = -iA{sfY{s, t) + C{sfZ{s, t) + Q{s, t)X* + Q{s, t)Et [X*{s)]\ds + Z{s, t)dW{s), 



se[t,T], 



Y{T,t) ^ G{t)X*{T) + G{t)Et[X*{T)]. 
Suppose {s,t) I— > (Y{s,t), Z{s,t)) is continuous onO <t < s <T and suppose 
(4.5) u*{t)^-R{t,t)-^{B{tfY{t,t) + D{tfZ{t,t)}, t e [0,T]. 

Then {X*{-), u*{-)) is an open-loop equilibrium pair of Problem (MF-LQ) for initial state x. 

Proof. For any fixed tG [0,T)andw(-) G ^[i,T], define w-(-) by (4.3) and let X^(-) = X{- ]t,X*{-),u^-)) 
be the solution to the following: 



(4.6) 



dX^s) = Ia{s)X''{s) + B{s)u%s)\ds + (c{.s)X^s) + D{s)u%s)\dW{s), s G [t,T] 
X^(i) =X*{t). 

Then (suppressing s) 

J{t,X*{t);u'{-))-J{t,X*{t),u*{-)) 

[Q{t){X' + X*),X' -X*) + { Q{t)Et[X' + X*],Et[X' - X*] ) 



+ {R{t){u^ + u*), u" -u^) + {R{t)Et[u^ + u*],Et[u' - u*] ) 
+ { G{t) [X'{T) + X*{s)\ , X'{T) - X*{T) ) 
+ {G{t)Et [X%T) + X*{T)] , Et [X'{T) - X*{T)] ) } 
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ds 



.n / {Qit){X' + X*) + Q{t)Et[X' + X*], X' - X* ) ds 

l-t+e 

{ R{t){u + u*) + R{t)Et[u + u*],u-u*)ds 



+ {G{t) [X'{T) + X*{s)] + G{t)Et [X'{T) + X*{T)],X'{T) - X*(T) ) }. 
Let (Y{- ,t), Z{- ,t)) be the adapted solution to BSDE (4.4). Then one has (suppressing (s,t)) 

d[{X''~X*,Y)] = \ {A{X' - X*) + Biu' - u*),Y) 

-{X^ - X\ {A^Y + C'^Z + QX* + QEt[X*]}) 



+ {C{X' -X*)+D{u'' -u*),Z) ds 

{ C{X' - X*) + D{u'' - u*), Y) + {X'' -X\Z) 
; u'' - u*,B'^Y + D'^Z ) - ( X^ - X*,QX* + QEt[X*] 

{ C{X^ - X*) + Diu" - -u*), Y) + {X^ -X\Z) 



dW 

ds 
dW. 



Thus, 



.[{X^iT) - X*{T),GX*{T) + GEt[X*{T)])] 



= E, 



[u'^u*,B^Y + D^Z)- {X'~X*, QX* + QEt[X*] ) 



ds. 



Consequently, 



J{t,X*{t);u^:))-J{t,X*{t),u*{-)) 



Et 



{ Q{X' + X*) + QEt[X' + X*] - 2QX* - 2QEt[X*],X' - X* ] 



ds 



+ { Riu" + u*) + REtiu" +u*) + 2B^Y + 2D^Z, u' - u* 

+ {G[X^{T)+X*{T)]+GEt[X''{T)+X*{T)]-2GX*{T)-GEt[X*{T)],X^{T)-X*{T))\ 



Et 



( Q{X^ - X*) + QEt[X^ - X*], X= - X* ) 

+ { i?(u' + u*) + i?Et(M' +u*) + 2B'^Y + 2D'^Z, u" - u* 

+ {G[X^{T)-X*{T)]+GEt[X%T)-X*{T)],X%T)~X*{T))\ 



ds 



= Et 



t+e 



( R{t) [u + u*] + R{t)Et [u + u*] + 2B'^Y + 2D'^Z, u~u*)ds 



+ / \Q{t)^ {X' - X* -Et[X' - X*]]\^ + \Q{t)-^Et[X' - X*]\^ds 

+ \G{t)^^{X%T)-X*[T)-Et[X%T)-X*{T)]]\^ + \G{t)Ht[X%T)-X*{T)]\^\. 



Let us denote 



u{s) ~ u{s) — u*{s), 

0{s, t) = R{s, t)u*{s) + R{s, t)Et[u*{s)] + B{s)'^Y{s, t) + D{sY Z{s, t). 
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Then 



Et {R{t){u + u*) + R{t)Et[u + u*] + 2B'^Y + 2B^Et[Y] + 2D^ Z + 2D^Et[Z],u- u* ) 

= Et { ( R{t)u + R{t)Et [u] +2e,u)] 

= Et {R{t){u-Et[u]] +R{t)Et[u] +2e,u-Et[u] +Et[u]) 

^Et[\R{t)'^{u-Et[^]\^ + 2{6,u-Et[^)^^t)--Et[u]\'' + 2{e,Et[u])] 
i\R{t)^ {u ~Et[u]] + R{t)-^e\^ + \R(t)^Et[u]+R{ty^Et[e]\^ 

- {R{t)-^e,e) - {R{t)-^Et[e],Et[e])y 



= E. 



Hence, 



J{t,X*{t)-u'{-))~J{t,X*{t)-u*{-)) 



E, 



t+e 



|%)5Et[u - u*] + R{t)-^-Et[B]? + \R{t)^{u - Et[u]} + R{t)-^e\^ 



ds 



\Q{t)"^{X-- ~X*^ Et[X' - X*]}|2 + \Q{t)"mt[X' - X* 



ds 



+ \G{t)'^{X'{T) - X*{T) - Et[X^{T) - X*{T)]]\^ + \G{t)'^Et[X%T) - X*{T)]\^ 



>-Et 



t+e 



t+e 



{R{ty^e,o) + {R{t)-^Et[eiEt[B])ys^ 

{Ris,t)-^e{s,t),9{s,t)} + {R{s,t)-^Et[e{s,t)],Et[eis,t)]})ds 



Note that under our continuity condition (see (4.5)), 



(4.7) 



\imEt\e{s,t)\^ ^ \e{t,t)\^ = 0, te [o,r]. 

s X-t 



(4.8) <^ 



Hence, (4.2) holds and {X*(-),u*{-)) is an open-loop equilibrium pair of Problem (MF-LQ) for the initial 
state X. n 

The above result leads to the following FBSDE family (parameterized by i G [0,T)): 

dX*{s) = (a{s)X*{s) + B{s)u*{s)\ds + (c{s)X*{s) + D{s)u*{s)\dW{s), se [0,r], 
dY{s,t) = -lA{sfY{s,t) + C{sf Z{s,t) + Q{s,t)X*{s) + Q{s,t)Et[X*{s)]\ds + Z{s,t)dW{s), 

0<t<s<T, 
X*{0) = X, Y{T,t) = G{t)X*(T) + G{t)Et[X*{T)], 
[, R{t,t)u*{t) + B{tfY{t,t) + D{t)^ Z{t,t) =0, te [0,T]. 

Inspired by [18], we suppose 

Y{s,t) = P{s,t)X*{s) + Pis,t)Et[X*{s)l se [t,r], 
for some deterministic functions P{- ,■) and P(- , •). Then 

-lA{sfY{s,t) + G{sfZ{s,t) + Q{s,t)X*{s) + Q{s,t)Et[X*{s)]\ds + Z{s,t)dW{s)=dY{s,t) 
= [Ps{s,t)X*is) + P{s,t)[A{s)X*{s) + B{s)u*is)] + P,{s,t)Et[X*is)] 

+P{s,t)(A{s)Et[X*{s)]+B{s)Et[u*{s)]\\ds + P{s,t)(c{s)X*{s) + D{s)u*{s))dW{s). 
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Hence, we need 



Z(s, t) ^ P{s, t) (c{s)X* (s) + D{s)u* (s)). 



Consequently, 

R{t, t)u* {t) + B{tfY{t, t) = -D{tfZ{t, t) = -D{tfPit, t) ( Cit)X*{t) + D(t)u* {t) 
Hence, (with P{s,t) = P{s,t) + P{s,t)) 



(4.9) 
and 



u*{t)^~[R{t,t)+D{tfP{t,t)D{t)\ ^ B{tfP{t,t)+D{tfP{t,t)C{t) X*{t) 



(4.10) 



Z{s, t) = P(s, t) {c{s)X* (s) + D{s)u*{s)\ 

= P{s, t)C{s)X*{s) -P{s, t)D{s) [R{s, s) + D{sfP{s, s)D{s)] "^ 
■ B{sfP{s, s) + D{sfP{s, s)C{s)] X*{s). 
Therefore, 

= Ps{s,t)X*{s) + P{s,t)[A{s)X*{s) + B{s)u*{s)] + Ps{s,t)Et[X*{s)] 

+P{s, t) (^A{s)Et [X* (s)] + B{s)Et [u* (s)]) 

+A{sfY{s,t) + C{sfZ{s,t) + Q{s,t)X*{s) + Qis,t)Et[X*{s)] 
= Ps{s,t)X*{s) + P{s,t)A{s)X*{s) 

-P{s, t)B{s)[R{s, s) + D{sfP{s, s)D{s)]-^[B{sfP{s, s) + D{sfP{s, s)C{s)]X*{s) 

+Psis,t)Et[X*{s)] + P{s,t)A{s)Et[X*is)] 

-P{s, t)Bis)[Ris, s) + DisfP{s, s)D{s)]-^[B{sfP{s, s) + D{sfP{s, s)C{s)]Et{X*{s)] 

+AisfP{s, t)X*is) + AisfPis, t)Et[X*is)] + C(s)^F(s, t)C{s)X*is) 

~C{sfP{s, t)D{s) [R{s, s) + D{sfP{s, s)D{s)] "^ [B{sfP{s, s)+D{sfP{s, s)C{s)] X*{s) 

+Qis,t)X*{s) + Qis,t)Et[X*{s)] 
= {P,(s, t) + P{s, t)A{s) + AisfP{s, t) + C{sfP{s, t)C{s) + g(s, t) 

- [P{s, t)B{s) + C{sfP{s, t)D{s)] [R{s, s) + D{sfP{s, s)D{s)] "^ 
■[B{sfP{s, s) + D{sfP{s, s)C{s)]}x*{s) 

+ {Ps{s, t) + P{s, t)A{s) + A{sfP{s, t) + Q{s, t) 

-P(s, t)B{s)[R{s, s) + D{sfPis, s)D{s)]-^[B{sfP{s, s)+D{sfPis, s)C(s)]}Et[X*(.s)]. 

The above wih be true if we let P{s, t) and P(s, t) = P{s, t) + P{s, t) be the solutions to the following coupled 
Riccati equations: 

Ps{s, t) + F(s, t)A{s) + A{sfP{s, t) + C{sfP{s, t)C{s) + Q{s, t) 
-[P{s,t)B{s) + C{sfP{s,t)D{s)][R{s,s) + D{sfP{s,s)D{s)]-'^ 
■[B{sfP{s, s) + D{sfP{s, s)C{s)] ^ 0, 
Ps{s, t) + P(s, t)A{s) + A{sfP{s, t) + C{sfP{s, t)C{s) + Q{s, t) 
~[P{s,t)B{s) + C{sfP{s,t)D{s)][R{s,s) + D{sfP{s,s)D{s)]-^ 
■[B{sfP{s,s) + D{sfP{s,s)C{s)] =0, se [t,T], 

[P{T,t)^G{t), P{T,t)^G{t). 
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(4.11) 



To summarize the above, we state the foUowing resuh. 

Theorem 4.3. Let (H1)-(H2) hold. Suppose Riccati equation system (4.11) admits a unique solution 
{P{- , •), P{- , •)) which is continuous in both variables. Then u*{-) G ^/[O, T] dehned by (4.9) is an open-loop 
equilibrium control and the corresponding X*{-) is an open-loop equilibrium state process. 

On top of the above result, one may study the solvabihty of Riccati equation system (4.11). In principle, 
the above gives a time-consistent solution to Problem (MF-LQ) of open-loop type. Let us look at a couple 
special cases: 

Case 1. The case of general discounting only. Let 
(4.12) i(.) = C(-)-0, B{-) = D{-)^0, 0(-,-)=0, i?(-,-) = 0, G(-) = 0. 

In this case, we have general discounting without conditional expectations. Clearly, 

1(.) = A(.), S(.) = i?(-), C(.) = C(.), D{-)^D{.), 
Q(-,-) = Q(-,-), R{-r) = R{-,-), G(-)-G(-), 

and P(- , ■) = P{- , •) satisfying 

' Ps{s, t) + P(s, t)A{s) + A{sfP{s, t) + C{sfP{s, t)C{s) + Q{s, t) 

~[P{s,t)B{s) + C{sfP{s,t)D{s)][R{s,s) + D{sfP{s,s)D{s)]-'^ 
■[B{sfP{s,s) + D{sfP{s,s)C{s)] =0, se [t,T], 

tP(r,t)-G(t). 



(4.13) 



The open- loop equilibrium control u*(-) is given by 

(4.14) u*{t) = - [R{t, t) + D{tfP{t, t)D{t)] "^ [B{tfP{t, t) + D{tfP{t, t)C{t)] X*{t), t G [0, T]. 

In addition, if C{-) = and D(-) = 0, the problem becomes a deterministic LQ problem with general 
discounting and we have 

(4 15) I Ps{s,t) + P{s,t)A{s) + A{sfP{s,t) + Q{s,t)-P{s,t)B{s)Ris,sy'BisfP{s,s) = 0, s G [t,T], 
\p{T,t) = G{t), 

with the open-loop equilibrium control u*(-) given by 

u*{t) = -R{t,t)-^ B{t)'^ P{t,t)X* {t), t G [0,T]. 

This result is comparable with those in [25] where closed-loop equilibrium solution was obtained for deter- 
ministic LQ problems with general discounting (without conditional expectation terms). 

Case 2. The case of conditional expectation at terminal only. Let 

Q{s, t) = g(s), g(s, t) = 0, R{s, t) = P(s), P(s, t) = 0, 

G{t) = G, G(i) = G. 
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(4.16) 



In this case, the conditional expectation appears at the terminal cost only without general discounting. This 
is a case studied in [14]. For such a case, both P{s,t) and P{s,t) are independent of i and (4.11) becomes 

' Pis) + P(s)A(s) + A{sfPis) + CisfPis)Cis) + Q{s) 

-[P{s)B{s) + C{sfP{s)D{s)][R{s) + D{sfP{s)D{s)]-^[B{sfP{s) + D{sfP{s)C{s)]=0, 
P{s) + Pis)A{s) + A{sfPis) + CisfPis)Cis) + Q{s) 

-[P{s)B{s) + C{sfP{s)D{s)][R{s) + D{sfP{s)D{s)]'^[B{sfP{s) + D{sf P{s)C{s)] = 0, 

.se[t,T], 
L P{T) = G, P{T) = G, 
and the open-loop equilibrium control is given by 

u*{t) = - [R{t) + D{tfP{t)D{t)] "' [B{tfP{t) + D{tfP{t)C{t)] X*{t), t e [0, T]. 

This essentially covers a relevant result in [14]. Note that as long as G 7^ 0, P(-) 7^ P{')- Then the 
equation for P{-) contains P{-) and it does not have a desired symmetry. Therefore, P{-) is not expected 
to be symmetric. Consequently, P(-) will not be symmetric either. Finally, if, in addition, G = 0, then 
P(-) = P(-) and it satisfies 

P{s) + P{s)Ais) + AisfP{s) + G(.s)^P(s)G(s) + Q{s) 

-[P{s)B{s) + C{sfP{s)D{s)][R{s) + D{sfP{s)D{s)]-^[B{sfP{s) + D{sfP{s)C{s)]^0, 

se[i,r], 

L P{T) = G. 

In this case, the problem is reduced to a classical stochastic LQ problem and it is time-consistent. For this 
case, the open-loop equilibrium control u*{-) is the optimal control and is given by 

u*{t) = - [R{t) + D{tfP{t)D{t)] "' [B{tfP{t) + D{tfP{t)C{t)] X*{t), t e [0, T], 

which recovers the result for classical stochastic LQ problem. 

We now make a couple of comments on this. 

The advantages: The approach is direct and the derivation of equilibrium pair is not very complicated. 
Moreover, the open-loop equilibrium control «*(•) admits a closed-loop representation (4.9). 

The disadvantages: (i) The Riccati equations in (4.11) do not have symmetry structure. Therefore the 
solutions P(- , •) and P(- , •) of the system are not necessarily symmetric. This leads to some difficulties in 
establish the well-posedness of the system, (ii) If the state equation contains conditional expectation, even 
the definition of open-loop equilibrium pair is not clear to us. 



(4.17) 



4.2 Close-loop equilibrium strategy. 

In this subsection, we introduce closed-loop equilibrium strategies. To this end, we first introduce the 
following: For any t G [0,r), 



Jit;X{-),u{-))^Et 



:Q{s,t)X{s),X{s)) + {Q{s,t)Et[X{s)],Et[X{s)]) 



(4.18) 



ds 



+ {R{s,t)u{s),u{s)) + {R{s,t)Et[u{s)],Et[u{s)]) 
+ {G{t)X{T),X{T)) + {G{t)Et[X{T)],Et[X{T)])] 
25 



for any (X(-), -«(■)) G ^[i,T] X ^[t,T]. We point out that in the above {X{-),u{-)) does not have to be a 
state-control pair of the original control system. Thus, J{t; X{-), u{-)) is an extension of the cost functional 
J{t,x; u{-)), and 

j{t;X{-;t,x,u{-)),ui-)) = Jit,x;ui-)), W{t,x)£&, u{-)£^[t,T]. 

Next, and hereafter, we denote any partition of [0,r] by A: 

A = {ifc I < fc < A^} = {0 = to < ti < t2 < ■ • • < ijv-i <tN= T}, 

with N being some natural number, and define its mesh size by the following: 



|A|| = max (tfe+i -ifc). 

0<A:<Ar-l 



For the above A, we define 

J,^(X(.),u(.))=E,, 
(4.19) 



T r- 



; Q(,s, tu)X{s),X{s) ) + { Q{s, U)Et, [Xis)],Et, [X{s)] ) 



ds 



+ ( R{s, tk)u{s), u{s) ) + { R{s, tk)Et, [uis)],Et, [u{s)] ) 

+ {G{h)X{T),X{T)) + {G{tk)Et,[X{T)],Et,[X{T)])}, 

for any {X{-),u{-)) e ^[tk,T] x '^[tk.T], fc = 0, 1, 2, • ■ • , A^ - 1. Again, in the above, {X(-),u{-)) does not 
have to be a state-control pair of the original control system. 

Now, we introduce some notions. 

Definition 4.4. Let A = {0 = to < ^i < • • ■ < ^N-i < t^ ^ T] he a. partition of [0,T], and let 
Q^,Q^ : [0,T] — > R™'^" be two given maps, possibly depending on A. 

(i) For any x e M" fixed, let X'^{-) = X'^{- ; x) be the solution to the following linear MF-SDE: 



(4.20) 



dx- 



\s)^{[A{s)-B{s)Q^is)]X^is) 

+[A{s) + B{s)[e^{s)-e^{s)]-B{s)e^{s)]Ep^^s)[X%s)]'jds 
+ {[Cis)~D{s)Q^is)]X^is) 

+[c{s)+D{s)[e^{s)-e^{s)]-D{s)e''{s)\Ep.^,^[x^{s)]]dw{s), se[o,r]. 



N-1 



X^(0)=a;, 
where 

k=0 

and let u'^(-) = u'^{- ; x) be defined by 

(4.21) u^is)^-e^is)X^is)+[e^is)-e^{-)]E,.^,^[X^{s)l sG[0,T]. 

The pair {X "^ {■) , u"^ {■)) is called the closed-loop pair associated with A and (0'^(-), 0'^(-)), starting from x. 
(ii) For each tk G A and any Uk{-) G '^[tk,tk+i], let Xk{-) be the solution to the following system: 

dXkis)^{A{s)Xk{s)+A{s)Et,[Xk{s)]+B{s)uk{s) + B{s)Et,[uk{s)]'jds 

+ {c{s)Xk{s) + C{s)Et,[Xkis)]+D{s)ukis) + D{s)Et,[uk{s)]}dWis), sG[ifc,ifc+i], 

Xkitk) = X^itk), 
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(4.22) < 



and X^-^(-) be the solution to the following: 

+\A{s)+B{s)[e^{s)-e^{s)]-B{s)e^is) 
+{[cis)-Dis)e^{s)]xt+A-^) 
'c{s)+D{s)[e^{s)-e%,)]-D{s)e^{s) 



(4.23) 



E 



P'^ (s) [^k+ 



E 



p'^{s)[^k+l 



X 



{s)]]dw{s), se[tfc+i,r], 



^ -'^fe+i(*fc+i) - ^fc(ife+i)- 



Denote 

(4.24) 



Xfc(-)©X^(.)^Xfc(.)/[t„t,+,)(-)+^.^+l(-)W„T](-), 

^.(•)®«^(-) = «fc(-)%.,*.+.)(-)-{e^(-)^f+i(-)+[e^(-)-e^(-)]V(-)[^.^+i(-)]}W.,T](-)- 

We call {Xk{-) © X'^(-), Wfc(-) ® u^{-)) a local variation of (X'^(-), u'^(-)) on [t^, tfe+i]. Suppose the following 
/oca/ optimality condition holds: 

(4.25) jA(^A(.)^^A(.)) <_^A(^^(.)g3^A(.)^^^(.)g3^A(.))^ V^,(.)G'^[tfc,tfc+l]. 

Then we call (6'^(-), <d^{-)) a closed-loop A- equilibrium strategy of Problem (MF-LQ), and call [X'^{- ; x), 
w (• ; x)) a closed-loop A-equilibrium pair of Problem (MF-LQ) for the initial state x. 

(iii) If the following holds: 



(4.26) 



lim 

l|A|KO 



l|0^(-) - e(-)||c(M;K™x„) + iie^(-) - e(.)||c(M;M™x„) 



0, 



for some 6, 9 G C([0,T]; M'"^"), then (9(-),0(-)) is called a closed-loop equilibrium strategy oi Piohlem 
(MF-LQ). For any {t,x) G &, let X*(-) = X*{- ■,t,x) be the solution to the following system: 



(4.27) 



dX*{s)^[A{s)-B(s)Q(s)\X*{s)ds+ [C{s)-D{s)Q{s)\X*{s)dW{s), se [t,T], 
X*{t) =x, 
and define u*{-) = u*(- ;i,a;) as follows: 

(4.28) u*{s)^-Q{s)X*{s), sG[i,r]. 

Then {t^x) h- > {X*{- ]t,x), u*{- ]t,x)) is called a closed-loop equilibrium pair flow of Problem (MF-LQ). 
Further, 

(4.29) V{t,x):^J{t,x;X*{-;t,x),u*{-]t,x)), {t,x) e S! 

is called a closed-loop equilibrium value function of Problem (MF-LQ). 

We point out that (0'^(-), ^'^(•)) and (6(-)i ©(■)) ^-^"^ independent of the initial state x E R". Let us now 
state the main result of this paper. 

Theorem 4.5. Let (H1)~(H3) hold. Then there exists a unique pair (r(- , •),r(- , •)) of §^ -valued 
functions solving the following system of equations: 

r, (s, t) + r(s, t) [A{s) - B{s)eis)] + [a{s) - B(s)e(.s)] ^r(s, t) + g(s, t) 

+ [dis) ~D{s)e{s)] ^r(.s, t) [C{s)~D{s)e{s)] +Q{sfRis, t)Q{s) = 0, 

r, {s, t) + r(s, t) [Ais) - B{s)e{s)] + [a(s) - B{s)e{s)] ^r(.s, t) + g(s, t) 

+ [C{s)~D{s)Q{s)]'^T{s,t)[C{s)~D{s)Q{s)] +Q{sfR{s,t)Q{s) =0, 0<t<s<T, 

r(r, t) = G(t), f(T, t) == G(t), < i < T, 
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(4.30) 



where Q{-) is given hy the following: 

(4.31) e(s) = [R{s, s) + D{sfT{s, s)D{s)] "^ [B{sff{s, s) + D{sfr{s, s)d{s)] , s £ [0, T]. 

The closed-loop equilibrium state process X*{-) is the solution to the following system: 

(432) f dX*{s) = [A{s) - B{s)eis)]X*{s)ds + [C{s) - Dis)eis)]X*{s)dW{s), s e [0,T], 

the closed-loop equilibrium control admits the following representation: 

(4.33) u*{s) = -Q{s)X*{s), se[0,T], 
and the closed-loop equilibrium value function is given by the following: 

(4.34) V{t, x) = {f{t, t)x, X ) , V(t, x) e &. 

Note that in (4.30), the equations for r(- , •) and r(- , •) are different: {Q{- , ■),R{- , ■), G{-)) appears in the 
former and {Q{- , •), R{- , ■), G(-)) appears in the later. Also, we see that the system is fully coupled. 

Let us look at two special cases. 

Case 1. The case of general discounting only. As in the previous subsection, let 

A(-)=C(-) = 0, B{-) = D{-)=Q, Q(-,-)=0, i?(-,-)=0, G(-)=0. 

In this case, we have 

'l(.)=A(.), B(-) = S(-), 5(.)=C(.), D{-)=D{-), 
^Q(-,-) = Q(-,-), R{-r)^R{-,-), G(-) = G(-). 
Thus, 

(4.35) e(s) = [R{s, s) + D{sfT{s, s)D{s)\ '^ [S(s)^f(s, s) + D{sYT{s, s)C{s)\ , s £ [0, T]. 
Hence, (4.30) becomes 

r,(s, t) + V{s, t) [A{s) - B{s)Q{s)\ + [A{s) - B{s)%{s)\ ^r(s, t) + Q(s, t) 
+ [C{s)-D{s)Q{s)\ '^r(s, t) [C{s) -D{s)Q{s)\ +Q{sfR{s, t)e(s) = 0, 

f,(.s, t) + r(s, t) [A{s) - B{s)e{s)] + [A{s) - s(s)e(s)] ^r(s, t) + q{s, t) 

+ [c{s)-D{s)e{s)]'^r{s,t)[c{s)-D{s)e{s)]+Q{sfR{s,t)e{s) = 0, se [i,r], 
r(r,i) = r(T,t) = G(t). 

Then, we see that 

f(s,t) =r(s,t), 0<t<s<T. 

Consequently, 9(-) = 0(-) and the equation for r(- , •) becomes 

r, (s, t) + r(s, t) [A{s) - B{s)e{s)] + [a{s) - B{s)e{s)] ^r(s, t) + q(s, t) 

(4-37) <( +[C{s)-D{s)e{s)fT{s,t)[Cis)~D{s)Q{s)]+e{sfR{s,t)Q{s)^0, s e [t,T], 

r(r,i) = G(t), 
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(4.36) 



(4.38) 



with 

e(.s) = [i?(.s, s) + D{sfris, s)Dis)] "' [B{sfT{s, s) + D{sfT{s, s)C{s)] . 

This coincides with a special case of the general result found in [27]. 

Case 2. The case of conditional expectation only. Let 

i(.) = C(-)-0, B{-)=D{-)^0, 

Q{s, t) = Q{s), Q(s, t) = Q{s), R{s, t) = R{s), R{s, t) = R{s), G{t) = G, G{t) = G. 

Note that unlike Case 2 in the previous subsection, we allow conditional expectation terms to appear in the 
running costs. In this case, one has 

2(.)=A(.), Bi-)=Bi-), a(-) = C(.), Di-)=Di-), 
Q{s, t) = Q{s), R{s, t) = R{s), G{t) = G. 

Thus, both r(s,i) and r(s,i) are independent of t and system (4.30) becomes 

r(s) + r(s) [A{s) - -B(s)e(s)] + [a{s) - B(s)e(s)] ^r(s) + q{s) 

+ [G{s)-D{s)%{s)\^T{s)[G{s)-D{s)Q{s)\+Q{sfR{s)Q{s)=Q, 
f (s) + f(s) [A{s) - B(s)e(s)] + [A{s) - B(s)e(s)] ^f(s) + Q{s) 

+ [G{s)-D{s)Q{s)\^T{s)[G{s)-D{s)Q{s)\+Q{sfR{s)Q{s)=G, 0<s<T, 

[ r(r) = G, r(T) = g, 

where 0(-) is given by the following: 

(4.39) e(s) = [^(s) + i?(s)^r(s)i?(s)] "' [B{sff{s) + i^(s)^r(s)G(s)] , s £ [0, T]. 

Further, if 

Q(-)=0, i?(-) = o, 

then we are in the case of conditional expectation at terminal cost only, and (4.38) becomes 
r(s) + r(s) [A{s) - B{s)Q{s)] + [A{s) - B{s)Q{s)] ^r(s) + Q{s) 

+ [cis)-D{s)eis)] ^r(s) [Gis] ^D{s)eis)] +eisfRis)eis) = o, 

r(s) + f(s) [A{s) - B{s)Q{s)] + [A{s) - B{s)Q{s)] ^f(s) + Q{s) 

+ [G(s)-L»(s)e(s)]^r(s)[G(s)-L>(s)e(s)] +e{sfR{s)&{s) = 0, < s < T, 

^ r(r) = G, r(T) = g. 

The closed-loop equilibrium state process X*{-) satisfies 

^4 4^^ i dX*{s) ^ [A{s) ~ B{s)e{s)]X*{s)ds + [G{s) - D{s)eis)]X*{s)dW{s), sG [o,r], 

the closed-loop equilibrium control admits the following representation: 

(4.42) u*{s) = -Q{s)X*{s), se[0,T], 



(4.40) 
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and the closed-loop equilibrium value function is given by the following: 

(4.43) V{t, x) = { f{t)x, X ) , V(t, x) G ^. 

Clearly, in the case that G = 0, the problem is reduced to a classical LQ problem. In this case, r(-) — r(-), 
and our result recovers the classical one. 

Directly comparing the results of this subsection with those in the previous subsection, we sec that the 
open- loop and closed- loop equilibrium solutions are different for Problem (MF-LQ), even for the above two 
special cases. The results coincide when the probelm is reduced to classical LQ problems. 



5 Multi-Person Differential Games 

In this section, we fix a partition A : = <o < ii < • ■ • < tN-i < tpf = T oi [0, T], and construct a closed- loop 
A-equilibrium strategy for Problem (MF-LQ). To this end, we introduce an associated A^-person differential 
game. For notational convenience, we label the players by 0, 1, 2, • • • , A^ — 1. The fc-th player controls the 
system on [tk, tk+i), with the cost functional being "sophisticatedly" constructed (see below). The main rule 
are the following: 

(i) Each player will play optimally based on the assumption that the later players will play optimally. 

(ii) The fc-th player will affect the {k + l)-th player's action through her terminal state (which is the 
initial state of the (fc + l)-th player). 

(iii) Although the fc-th player will not be able to control the system from tk+i on, she will still "discount" 
the cost functional in her own way on the interval [tk+i, T]. 

Let us now look at the iV-person differential games in details. In what follows, we denote 



Qk{s)^Q{s,tk), Rk{s)^R{s,tk), Gk = G{tk), 
[Qkis)^Qkis) + Qkis), Ms)^Rkis) + R^is), Gk = Gk + Gk, 



0,1,- 



,N-1. 



We will carefully look at Players (TV — 1), (A^ — 2), and (A^ — 3), who will have different features. Once we 
have done that, the situations for the rest players will be clear and can be treated inductively. We now begin 
with Player (A^ — 1). The state equation for this player is the following: 

' dXN-i{s) = [A{s)XN-i{s) + Ais)Et^_, [Xn^s)] + B{s)un-i{s) + B{s)Et^_, [uAr_i(s)]}d5 
(5^^) ) +{G{s)XN^i{s) + C{s)Et^_AXN-i{s)]+D{s)uN-iis)+D{s)Et^_AuN-i{s)]}dW{s), 

S e [tN-l,tN], 

and the cost functional is given by 



:E. 



(5.2) 



'ijv-1 



( Qn~i{s)Xn-i{s), Xw_i(5) )4-( QN-iis)Et^_, [XAr_i(s)], Et„_, [Xjv_i(s)] ; 



ds 



+ (i?Ar_l(s)ujV-l(s),U7V-l(s)) + (-RN-l(s)Et„_JuAr_i(s)],Et„_JuAr_i(s)]) 

+ {GN-lXN-litN), XN-l{tN) ) + (GAr_iEt„_JX7v_i(ijv)],Et„_JXAr_i(ijv)] ) j" 
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Player {N — 1) wants to solve the following problem. 

Problem (MF-LQ)Ar_i. For any xjv-i S ^tN~i^ find a u*]^_^{-) G '^[fTv-ij^w] such that 

(5.3) Jn-i{xn-uu*^-i{-)) ^ , inf J^_i(xa,_i; ujv_i(-))- 

This is a standard LQ problem for MF-SDEs. According to Proposition 3.1, under (H1)-(H2), one 
has a pair of S"-valued functions {Pisi-i{-),Pn-i{-)) uniquely solve the following Riccati equations (s is 
suppressed) : 

Pn-1 + Pn-iA + A^Pn-1 + C^Pn-iC + Qn-i 
^{Pn-iB + C^Pn-iD){Rn^i+D'^Pn-iD)-\b'^Pn-i+D^Pn-iC)=0, 

(5.4) <! Pn-i + Pn-iA + A'^Pn^i + C^Pn^iC + Qn-i 
^{PN-iB+d^PN-iD){RN-i+D'^PN-iD)-\B^PN-i+D'^PN-iC) = 0, se[tN-i,tN), 

^ P/V-l(i7v) = Gat-i, PN-l{tN) = Gn-1- 



Define 



(5.5) 



On-i = {Rn-1 + D'^Pn-iD)-\B^Pn-i + D^Pn-iC), 
Qn-i = {Rn-1 + D^Pn-iD)-'{B^Pn-i + D'^Pn-iC), 



s e [tN-i,tN]- 



Then the optimal state process X'^_^{-) = X'^_^{- ;ijv_i,XAr_i) solves the following closed-loop system: 
' dX*^^^ = {[A- BOn-i] ^w-i +[A + B{eN-i -Qn-i)- Sejv-i] IEt„_i [X*^^i]}ds 

(5_g) I +{[c-DeN-i\x*^_^+[c+D{eN-i-eN-i)-DeN-i]Et^_dx*N^i]}dw{s), 

. ^N-li^N-l) = Xn-1, 

and the optimal control w^_j^(-) = u*j^_-^^{- ; tjv_i, a;jv_i) admits the following state feedback representation: 

(5.7) U%_^{s) = -eAr_i(s)XiV_i(s) + [ON-lis) - ew-l(s)]Et„_,[XiV„i(s)], S G [tN-l,tN]. 

Finally, 

, , , inf J^ _-i^ix N -1] UN -li-)) = J N-iixN-uulf _^{-)) 

(5.8) UN-ii-)e''^[tN-i,tN] 

= {PN-l{tN-l)xN-l,XN-l): V.TAr_i G .^In^i- 

This way, Play {N - 1) has solved Problem (MF-LQ)Ar„i. 

Next, we consider Player {N — 2) whose state equation is the following: 

dXN-2{s) = \^A{s)Xn-^2{s) + A{s)Et^_^ [Xn^2{s)] + B{s)un-2{s) + B{s)Et„_, [uN-2{s)]}ds 
(5 g) I +\c{s)XN^2{s) + C{s)Et^^,[XN^2{s)]+D{s)uN-2{s)+D{s)Et^_,[uN-2{s)]}dW{s), 

S G [tAr_2,ijV-l], 
. X{tN-2) = Xn^2 G ^tiv-2- 

Let Xjv-2(-) = X{- ; tN-2, xn-2,un-2{-)) be the corresponding solution. At s = i^-i. Player {N — 1) takes 
over the system, and will use her optimal control u^_i(-) of state feedback form (5.7) on [tN-i,tN], where 
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^iv-i(') satisfies closed-loop system (5.6) with initial state xjy-i = XN^2{tN~i)- Because of this, Player 
(A^ — 2) considers the following (sophisticated) cost functional (suppressing s) 



Jn-2{^N-2\UN~2{-)) 
='tjv-2 



(5.10) 



+ 



{Qn-2Xn-2,X]SI-2) + {QN-2^tN-A^N~2]-,^tN-2[^N-2] ) 

ds 

{QN-2X*iq_i,X*j^_^ ) + {Qf^_2^tN-2[^*N-l\-'^tN-2[^*N-l\ ) 

ds 



tN-2 

+ {Rn-2UN-2,UN-2 ) + {RN-2^tN-2[uN-2],^tN-2[^N-2] ) 

tN-1 



+ ( i?jV-2U^-l' ^jV-1 ) + ( fljV-2Et„_2 [^tAT-l]' IEtiv-2 [""jV-ll ) 

+ ( GN~2X'^_i{tN), X]^_;^(ijv) ) + ( GN~2^tN-2 [^N~litN)],^tK-2 i^N-litN)] )>■ 

Note that the appearance of Qn-2,Qn-2,Rn-2,Rn-2,Gn-2,Gn-2 and Etjv-2 in the running cost over 
[^AT-i, tjv] and in the terminal cost exactly explains the meaning of "discounting in her own way" for Player 
{N — 2) mentioned earlier (see Rule (iii) at the beginning of the section). We now want to rewrite the above 
cost functional so that Player {N — 2) will face a standard LQ problem for an MF-SDE on [tN-2, ijv-i]- To 
this end, we observe the following: (noting (5.7)) 

(5.11) Et^_,[u%_^is)] ^ -&N-l{s)Et^_AX*N-i{s)], S e {tN-l,tNl 



(5.12) 
and 
(5.13) 
Thus 



IjV-2 = Et 



d{Et^_,[X*^_^]) = (A - BeN-i)Et«^dX*N-i]ds, se [tN-i,tN], 

d{Et^_,[X*^_,]) = {A - mN-l)Et^^2[X*N^l]ds, S e [tN-l,tN], 



{Qn~2X'^_1,X'^_-^ ) + (QAr_2Et„_JX^_j],E4„_JX^_j] ) 



+ ( RN-2ul,_i,U*]y_^ ) + ( i?jV-2Et„_2 [l 



Af-lJl^tN-2l^JV 



-ll) 



ds 



+ {GN-2X'^_l{tN),Xlf_i{tN) ) + {GN-2E,t,^_2[X]s[-i{tN)],Et,^_2[X'^_i{tN)] ) j- 

( Qn-2X^_i, X'^_i ) + ( QN-2EtN_2 [XN-l]:^tN-2 i^N-l] ) 

+ {RN-2{QN-lXlf_i + {On-1 — 9Af-l)Et„_JX^_j]|, 

©AT-l-'^AT-l + (©Af-l — 0Af-l)Ef„_^ [X'^_i] ) 
+ ( -RAr-20JV-lEt„_2 [X^_;^], 6Ar_iEt„_2 [Xj^_;^] ) ds 
+ {GN^2X^_l{tN),X'^_l{tN) ) + (GjV-2Et„_JXj^_i(tAr)],E4„_JXj^_]^(iAr)] )| 



tN-l 



{Qn-2 + 0Ar_i-RAf-20Ar-l)-'fiv-li^Af-l ) 



+ ( \^N-iRn-2Qn-1 — 0Ar-i-RAr-20Af-l)Ef„_;^ [X^_j], Ef„_j [X'^_i] ) 

+ ( {QN-2 + Ol^iRN-2eN-l)Et^^2 [X*N^lh^t^^2 [X*N-l] ) ] ds 

+ {GN-2X^_i{tN),X'^_j^{tN) ) + {GN-2Et^_2[X'^_i{tN)],Et^_2[X^_j^N{tN)] )|. 
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Note that on the right hand side of the above, both Et„_j and Et„_2 appear quadratically. Suggested by 
Lemma 2.4, we introduce the following three Lyapunov equations on [1^^1,1^]: 



rN-2+rN-2{A-BeN-i)+{A - BeN^ifrN-2+ Qn-2 

^N~2{tN) = GjV-2, 



S e [tN-l,tN), 



(5.15) 



and 



rW-2 + rN-2{A - BOn-i) + {A- BQN-lfTN-2 + Qn-2 

+{d - DeN-ifrN-2{c - dQn-i) + el_,RN-2QN-i = o, se [ijv-i, ^^v), 

^N-2{tN) = Gn-2, 



f jv-2 + f w-2(A - bOn-i) + {a~ BeN-ifrN-2 + Qn-2 + el_,RN-2eN-i = 0, 

(5-16) <! se[tN-l,tN), 

^N-2itN) = Gm-2- 

Then, using Lemma 2.4, the sophisticated cost functional of Player {N — 2) can be written as 

Jn-2{xN-2\UN-2{-)) 



E* 



(5.17) 



{QN-2XN-2-,Xff^2 ) + {Q N -2^t„ -2[Xn ~2\,^tN -2[Xn -2] ) 

ds 



+ {Rn~2UN-2,Un~2 ) + (-RAf-2Et„_2[ujV-2],Et„_J-UAr_2] ) 

+ {^ N -2{iN -i)Xn -2{tN -1) 1 X ff ^2{tN -l) ) 

+ {^N-2{tN-lW'tN-2[XN-2{tN-l)\i^tN-2[XN-2{'tN-l)\ ) \- 

This is a standard cost functional of an LQ problem for MF-SDEs on the interval [tN-2itN-i\ now. We see 
that Lemma 2.4 plays an interesting role here. 

Let us make two observations. First, we note that, in general, 

{PN-l{iN-l)XN-2{iN-l)-,Xff^2{iN-l)) = J N-i{Xn -2{iN -l)\U*jq_^{-)) 



E. 



( Qn-iX%_i, XIj_^ ) + ( Qm-Am-1 [X*N~l\^^tM-i [X*N^i] ) 
+ ( i?Ar_iuJV-l7 "iV-l ) + ( Rn-Am-1 [^tAT-l]) IEt„_i [Un^i] ) ds 



+ {GN-lX'^_l{tN),Xlj_i{tN) ) + {GN-l^tN-i[XN-liiN)],^tN-i[XN-l{'tN)] ) }• 

7^ IjV-2 = Et„_2| / {Qn-2X'^_j^,X^_^j^) + {QN-2^tK-2[XN-l]i^tN-2[XN-l]) 

+ ( i?Ar_2W^_l, "w-l ) + ( RN-2^tM-2 ["jV-l] ) IEt„_2 [^^W-l] ) ^.S 

+ {GN-2X'}q_i{tN),X'^_l{tM) ) + {GN-2^tN-2[XN-i{tN)\,^tN-2[XN-l{^N)] ) \ 
= {^N-2{tN~l)XN-2{tN-l),X]y-2{tN-l) ) 

+ {^N-2{tN-l)^tN-2[XN-2{tN-l)],^tN-2[XN-2itN-l)] ) f, 

since the weighting matrices are possibly different, and conditional expectation terms are different. 
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Second, if we let 



Ais) = A{s) - B{s)Qn-i{s), C(s) = C{s) - D{s)QN-iis), 

Ais) = A{s) + B{s)[eN-i{s) - eN-i{s)] - B{s)eN-iis), 
c{s) = c{s) + D{s) [ejv-i(s) - ejv-i(s)] - ^(s)ejv-i(s), 

Q{S) = Qn-2{s) + eAr_i(sf i?w_2(s)ew_i(s), 
Q(S) = el_iRN-2{s)eN-l{s) - eN~l{sfRN-2{s)eN~l{s), 
[ Q(S) = QN-2is) + QN-lisfRN-2is)eN-lis), 

then, under (H1)-(H2), one has 

' Q(s) > 0, 

Q{S) + Q{S) = Qn~2{s) + ew„l(s)^i?Ar_2(s)eAr_i(s) > 0, 

I Q{s) + Q{.s) + Q{s) = Qjv-2(s) + ejv^i(s)^i?jv-2(s)ejv-2(s)>0. 
Thus, by Lemma 2.4, we have 

(5.18) rAr_2(tiV-l), TN-2{tN-l)+fN-2{tN-l)>0- 

Having the above, we now pose the following problem for Player {N — 2). 

Problem (MF-LQ)iv-2- For xn-2 G ^tw-a: find a w^_2(') ^ '^[tN-2,tN-i] such that 



(5.19) 



J^-2(^W-2;U^-2(-)) 



inf 

UN-2i-)e'^ltN~2,tN-l] 



Jn-2{^N~2]Un~2{-))- 



Similar to the case of Player [N — 1) above, under (H1)-(H2), there exists a pair {Pn ~2{-) , Pn ~2{)) 
uniquely solve the following Riccati equation system: 



(5.20) 



Pn-2 + Pn-2A + A^Pn-2 + C'^Pn-2C + Qn^2 

-{Pn-2B + C^Pn-2D){Rn-2+D'^Pn-2D)-\B^Pn-2 + D'^Pn-2C)={), 
Pn-2 + Pn-2A + A^Pn-2 + C^Pn-2C + Qn-2 

-iPN-2B + C^PN-2D){RN-2+D'^PN-2Dy\B^PN-2+D^PN-2C)^0, S e[tN-2,tN-l) 
PN-2{tN~l) — ^N-2{tN-l), PN-2{tN-l) ~ ^N-2{iN-l) + rA'-2(^Ar~l)- 



Define 

(5.21) 



Qn-2 = {Rn-2 + D^Pm-2D)-\B^Pm-2 + D^Pn-2C), 



Qn-2 = {Rn-2 + D^Pn-2D)-\B^Pn-2 + D^Pn-2C), 
Then the optimal state process X'^_2{-) solves the following closed-loop system: 



S e [tN-2,tN-l]- 



^ds 



(5.22) 



' dX*^_2 ^{{A- BQn-2)X*^-2 +[A + B{eN-2 - eN-2) - BeN-2]^t^^AXN-2\}c 

+ [{C-DeN-2)X*^-2+[C + D{eN-2-eN-2)-DeN-2]^t^^AX*N-2]}dWis), 

S G [tN-2,tN-l], 
^ ^N-2itN-2) ~ X]y^2, 
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and the optimal control u*j^_2{-) = u*j^_2i' ;^a'-2, 2:^-2) admits the following state feedback representation: 

(5.23) U%_2{s) = -eN-2{s)X*^_2is)+[QN-2{s)-eN-2{s)]Et^_,[X*^_2{s)], SG [tjV-2 , ^W-l] ■ 

Finally, the following holds: 



(5.24) 



,, inf J^_2{xN-2;UN-2{-)) ^ JN-2ixN-2;U*^^2i-)) 

fJV-2(-)e « l*N-2, tjV-lJ 



{PN-2{tN-2)xN-2,XM-2), \/xN~2&^t,. 



Thus, Player (A^ — 2) has solved Problem (FM-LQ)jv-2- Different from Player {N — 1), we need to solve 
three Lyapunov equations in order to transform the complicated-looking sophisticated cost functional into a 
standard cost functional for a controlled linear MF-SDE. Thus, the situation of Player (A^ — 2) is interestingly 
different from that of Player [N — 1). 

Next, we consider Player (N — 3) on [ijv-3,^Af-2]- For any a;Ar_3 G <St„_3, consider 

dXAr_3(s) = { A(s)XAr„3(s) + A(s)Et„_3 [Xw„3(s)] + B(s)?/Ar_3(s) + B(s)Et„_3 [Ww_3(s)]}ds 

(525) J +[c{s)XN-z{s) + C{s)¥.t^_,[XN-z{s)]+D{s)uN-z{s)+D{s)^t^_,[uN-z{s)]]dW{s), 

S e [iiV-3,ijV-2], 

Due to the fact that Players {N — 2) and [N — 1) will play optimally on [tAr-2,^Ar-i) and [tAr_i,i7v], 
respectively, the resulting state process, denoted by X^{-). on [t7v-2,^7v] will satisfy the following: 



(5.26) < 



where 



and 



dX^ = {(A - BQ^)X^ +[A + B{e^ - e^) - Be^]EpA(,)[X^]}ds 

+{(c - De^)x^ + [c + D{e^ - e^) - De^]Ep^(^,^[x^]'jdw{s), s e [tN~2,tN] 

X {tN-2) = -^^^-3(^^-2), 



e'^(.s) ^ eAr_2(s)/[t„_3,t„_i)(s) + eAr_i(s)/[t„_^,t„](s), 



e (s) = eAr_2(s)/[t„_2,t„_i)(s) + eAr_i(s)/[t„_,,t„](s), 



S G {tN^2,tN], 



P {s) =tN~2l[tN-2.tN-i)is) + iN-lI[tM-i,tN]i^)^ S G [tAr_2,ijv]- 



The corresponding control on [tAr_2,ijv] takes the following form: 

u^{s) ^ ~e^{s)x^{s) + [e^is) - e^(,s)]E,A(,)[x^(s)] 

(^■27) f -eAr_i(s)X^(s) + [Qn-i{s) - eAr„i(s)]Et„_JX^(s)], S G [tAr_i,iw], 

-ew_2(s)X^(s) + [e^_2(s) - ejV-2(s)]Et^_,[X^(s)], S G [tN-2,tN-l). 
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Similar to Player {N — 2), Player {N — 3) considers the following (sophisticated) cost functional 



(5.28) 



where 



Et. 



{Qn-3^N-3tXn-3 ) + {QN-3^tN-3[^N-3],^tN-3[^N-3] ) 



+ ( Rn~3UN-3, Un-3 ) + ( RN-3^tN-3 [uN-3] , ^tjv-s [uN-3] } 



ds 



+ 



tN 



( Qn-3X'^, X^ ) + ( QAr-3lEt„_3 [X%Et,_, [X^] ) 



+ ( Rn-su"^, u'^) + { RN-S^t^-s K] , IEt„_3 [u ] ) 



d.s 



+ (Gjv-3^^(tAr),^^(tAr)) + (G^-3Et„_3[X^(ijv)],IEt„_3[^^(^w)])} 
(Qw-3-'^Af-3)^Af-3 ) + (QAr-3Et„_3[XjV-3],IEf„_3[XAr_3] ) 



+ ( RN-3UN-3, UN-3 ) + ( i?Ar-3Etiv-3 ["^-3], Et„_3 [ltAr-3] ) 



ds + lAT-a, 



I 



N~3 = lEtjv-3 



( gAr_3^'', X'^) + { QjV-3lEt„_3 [^""J , Et„_3 [X^] ) 



+ ( i?w-3w'', u'^) + { i?Ar_3lEt„_3 [« ], IEt«-3 [" ] ) 



ds 



Et. 



+ (G^_3X^(tiv),^'^(ijv)) + (GAr_3Et„_3[X'^(ijv)],Et„_3[X^(tw)])} 
( gw_3X^, X^) + { Qjv_3E,„_3 [X'^], E,„_3 [X'^] ) 

-2 



+ ( i?w_3e^E,„_3 [x^] , e^E,„_3 [x^] ) 



ds 



+ ( GAr_3^^(tiv), X^(tjv) ) + ( Gw-3Et„_3 [X'^(tA')], Et„_3 [X'^(tw)] )} 



ds 



E(:„_, 



+ ( [QN-3+ie^fRN-3Q^]'Rt^^Ax%Kt,^,[x^] ) 

+ ( GN-3X'^{tN), X^{tN) ) + ( Gw-3Et„_3 [X^(tiv)], Et„_3 [X^(t^)] )} 

([Qiv-3 + (e^)^i?^-3e^]x^,x^) 
+ ( [{e^fRN-3e^ - (e^)^i?jv_3e^] e,„_, [x^], e,„_, [x^] ) 

+ ( [Qn-3 + {&^fRN-3&^] Et„_3 [X^^] , Et„_3 [^^] ) ] c«s} 



-Et 



[QN-3 + {e^fRN-3e^]x^,x^) 



+ ( [(e^)^i?jv-3e^ - {e^fRN-30^] Et,_, [x%Et,_, [x^] ) 



ds 



+ { [QN-3 + {&''fRN-3Q^]Et^^,[X%Kt,-,[X'^] ) 

+ ( GN-3X'^{tN), X^{tN) ) + ( Gw-3Et„_3 [X'^{tN)],Et^_, [X'^itN)] )}. 

To take care of the above, we apply Lemma 2.4, by introducing the following three Lyapunov equations on 
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[tN-2,tN]'- 



(5.29) 



Tn-3 + TN^siA - se^) + (A - Be^^y Tn-3 + Q 



N-3 



A\T 1 



(C - De^y TN-siC - DQ"^) + (e^)^ RN-aO 



0, 



(5.30) 



and 



(5.31) 



S E {tN-2,tN-l) U (tiV-l,iAf), 
rAr-3(ijv) = Gn-3, ^N-3{tN-l) = ^N-sitN-l), 

f Ar_3 + rN-3{A - Se^) + (1 - Be^)^rAr_3 + Qn-3 

+{d - DQ'^ffN-siC - DQ^) + {e^fRN-sQ"^ = 0, s e [tjv-2, ^iv), 

riV-3(^A') = GjV-3: 



rAr-3 + rN-3iA - se^) + {a- B)e'^y Tn- 



rjv-3(ijv) — Gn-3- 



}n-3 + (e^)^ i?Ar-3e^ - 0, 

S e [ijV-2,iAf), 



Note that different from the situation of Player (N — 2), the Lyapunov equation for rAr_3(-) is formulated 
on two intervals and there might have a jump at tj^^i for r7v-3(-)- Then 

rtf. 



Et. 



[QN-3 + ie^fRN-30'^]X^,X 

tiV-1 



[QAr_3 + (e^)^i?N-3e^] Et„_3 [X^] , Et„_3 [X^] 



ds 



+ ( GN-3X^(tN),X^{tN) ) + ( GAr_3Et„_3 [X^(fjv)], Et„_3 [X^(tA.)] )} 
— ^tN-3\ {^N-3itN-l)X {tN^i),X (tw-i)) 

+ (fAr_3(tw-l)Et,^_3[X^(tAr_i)],Et„_3[X^(f^_l)])}. 

In the same manner, we have 



^N-3 — Et„_g 



iiV-1 



( [Qn-3 + {e^fRN-3e^]x'^,x 



+ { [{e^fRN-3e^ - {e^fRN-3e^] Et„_, [x%Et,_, [x^] ) 
+ ( [Oiv-3 + (e^)^i?7v-3e^] Et„_3 [^"^l - E,„_3 [x^] ) ] ds 

+ (rAr_3(tAr_i)X^(tAr_i),X^(tAr_i)) + (fjv^3(ijV~l)E,„_3[X'^(ijV-l)],Et„_3[X^(tAr_i)])} 
= Et„_3{ ( TN-3itN-2)X^itN-2), X^{tN-2) ) + {r N-3{tN-2)^t^ ^, [X^itN-2)],Kt^_, [X^itN-2)] )}• 

Hence, the sophisticated cost functional for Player {N — 3) can be written as 



JN-si^N^S^UN-si-)) 



(5.32) 



iiV-2 r 



tN-3 



{Qn-3Xn-3iXn-3 ) + (QAr_3Et„_3[X7V-3],Ef„_3[X7v_3] ) 

ds 



+ {Rn-3Un~3,Un^3) + (-RjV-3Ef„_3[liAr-3],Et„_3[wjv_3] ) 

+ {^N-3{tN-2)XN-3{tN-2),X]ys{tN-2) ) 

+ {^N-3{'tN-2)^tN-3{XN~3itN-2)],^tN-3iXN-3{tN-2)] ) f 
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Note that in solving (5.29)-(5.31), we first solve (5.29) on [iyv-ij^Af], then solve (5.30) on [iw-ijiAf]- After 
that, solve (5.29) on [tN-2,tN-i], and (5.30) on [tN-2,tN-i]- Solving (5.31) is more directly. 
Similar to the situation for Player {N — 2) (see the derivation of (5.18)), we first have 

^N-3{tN-l), ^N-3{tN~l) +^N-3{tN-l) > 0. 

Then applying the same argument, we will have 

^N-3{tN-2), ^N-3{tN-2) + ^N-3{tN-2) > 0. 

Therefore, we can pose the following problem for Player {N — 3). 

Problem (MF-LQ)Ar_3. For xn-s G >^tN_3, find a u%_^{-) G '^[tN-3,tN-2] such that 



(5.33) 



JN-3i^N^3;u*N-3i-)) ^ ,, inf •JN~3ixN-3;UN-.3i-))- 

"N -3 (■)£"«[*« -3, tN-2j 



This is a standard LQ problem for MF-SDEs now. Under (H1)~-(H2), there exist a pair {Pn^3{-), Pn-3{-)) 
uniquely solve the following Riccati equation system: 



(5.34) < 

Define 

(5.35) 



Pn-3 + Pn-3^ + ^ Pn-3 + C Pn-sC + Qn-3 

_ -{Pn^3B + C^Pn-3D){Rn-3 + D'^Pn-3D)-\B^Pn-3 + D^Pn-3C) = 0, se[tN-3,tN-2), 
Pw_3 + PN-3A + A'^Pn-3 + C^Pn-3C + Qn~3 

-{Pm-3B + C'^Pn-3D){Rn-3 + D'^Pn-3D)-\b'^Pn-3 + D'^Pn^3C)=Q, SG[ijV-3,%-2), 

, PN-3{tN-2) = ^N-3{tN-2 + 0), PN-3{tN-2) = ^N-3{tN-2) + ^N-3{tN-2)- 



Qn-3 - {Rn-3 + D' PN-3Dy'{B' Pn-3 + D' PN-3C), 



S £ [ijV-3 7^Af-2]- 



>ds 



ejV-3 = iRN-3 + D' PN-3Dr\B' Pn-3 + D' PN-3C), 

Then the optimal state process X'^_^{-) solves the following closed-loop system: 

' dXiV_3 - {(A - BeN-3)X*N-3 +[A + B{eN-3 - On-3) - BeAT^a] IEi„_3 [^iV-s]}' 
(5_3g) I +[iC-DeN-3)X%_,+[C+DiQN-3-eN-3)^DeN-3]Kt^-dX*N-3]}dWis), 

S G [tN-3,tN-2], 
, X'^_^{tN-3) = Xn-3, 

and the optimal control w^3(-) = u*j^_^{- ; tjv_3,a;jv_3) admits the following representation: 

(5.37) U^_3(s) = -eAr_3(s)X^_3(s)+[eAr_3(s)-eAr_3(s)]lEt„_3[X^_3(s)], S G [ijV-S, iiV-2] . 

Finally, the following holds: 



(5.38) 



, , iiif , J^_3(a;Ar_3; UA,_3(-)) = J^_3(a;jv-3; "w-sl')) 

MN-3(-)6 » l*iV-3, tN-2] 



{PN-3itN-3)xN-3,XN-3), '^Xn-3 G ^t^-s 



As a result. Player (A^ — 3) solves Problem (MF-LQ)Ar_3. The major difference between the situations of 
Player (A^ — 3) and Player {N — 2) is that the Lyapunov equation for r7v-3(-) has a possible impulse at ^Af-i- 
We actually have used Lemma 2.4 on [tN-i,tN] and [tN-2,tN-i] separately. 
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By induction, we can construct the following finite sequences 

(Pfc(-),Pfc(-)), 0<k<N-l, 

(ffe(.),rfe(.),f,(.)), 0<k<N-2, 

where (-Pfe(-)i Pki-)) satisfies the following Riccati equation system: For < k < N ~ 1, 

Pk + PkA + A^Pk + C^PkC + Qk 

~{PkB + C^PkD){Rk + D^PkD)-\B^P^ + D^PkC) = 0, 
(5.39) { p^ + PkA + A^P,, + C^PkC + Qk 

-{PkB + C^PkD){R,,+D^PkD)-\B^Pk+D^PkC) = 0, s e [tk,tk+i), 

^ Pk{tk+i) = Tk{tk+i), Pk{tk+i) = Tk{tk+i) + fk{tk+i), 

with the convention that 

^N-litw) = Gn-1, ^N-l{tN) + ^N-litw) = Gn-1- 

and (rfe(-),rfc(-),r/j(-)) satisfies the following Lyapunov equation systems: For < A: < iV — 2, 



(5.40) 



Tk + TkiA ~ Se^) + (A - BS'^y Tk + Q 



N-l 



^k{tN) = Gk, Tk{tN~l) = rfc(tAf_i), • • • , Tk{tk+2) = Yk{tk+2), 



tk + Tk{A - BQ^) + {A- BQ^fTk + Qk 
(5-41) { +{d-DQ^ffk{d-DQ^) + {e^fRke^=0, se[tk+i,tN), 

rfc(tAr) = Gk, 

and 



(5.42) 



rk+TkiA-Be^)+{A-Be'^yTk+Qk+{e'^rRke'^=o, se[tk+i,tN) 



^kitw) — Gk- 

where, for < fc < A^ — 1, 

e^(,s) - [Rkis) + D{sfPk{s)D{s)] -' [B{sfPk{s) + D{sf Pk{s)C{s)] , 
e^{s) - [Rk{s) + DisfPk{s)Di.s)] -' [B{sfPkis) + Disf Pkis)Cis)] , 

Next, we define 

(5.43) u^is) = -e^(s)X^(s) + [e^(s) - e^(s)]E,A(,)[X^(s)], s e [0,ijv]> 
where 

N-2 

(5.44) p^(s) = Y. tkI[t„t,+Ms)+fN-iI[t._„t.]{s), s e [0,T], 



se [tk,tk+i]- 



fc=0 
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and define X^{-) by the solution of the following closed-loop system: 



(5.45) 



ds 






S&[0,tN], 



X^(0)=.T. 

Then one has that 



(5.46) 



inf jt{X^it,);u,{-)) ^ Jt{X'^itky,u^i-)\ ) 

= {P^{tk)X^{tk),X^itk)), 



0<k< N -1. 



From the above, we see that {Q'^ {■) , Q'^ {■)) is a closed-loop A-equilibrium strategy of Problem (MF-LQ), 
and (X^(-),u^(-)) is the associated closed-loop A-equilibrium pair. 

To conclude this section, we note that rfc(-) = Tk{-) + ^k{:) satisfies the following Lyapunov equation: 

Ffc + fk{A - BS^) + {A- BS^ffk + Qk + iC- DQ^ffkiC - DQ^) + {S^fRkQ^ = 0, 
(5-47) \ se[tfe+i,tjv), 

rfc(tAf) = Gk- 
6 Convergence. 

In the previous section, for any given partition A of [0, T], a closed-loop A-equilibrium strategy (9'^(-), 0'^(-)) 
is constructed. The goal of this section is to establish the convergence of (8'^(-), 9'^(-)) as |[A|| — !> 0. To 
achieve this, we first present a technical result in which a partition A : = to < ■ ■ ■ < t^ = T oi [0,T] is 
given. 

Proposition 6.1. Let (H1)-(H3) hold. Let Q^,Q*,G*,G* G S", and R^,R^ E §™ sucii that 



3.1) 



Q{s,T)<Q,, Q{s,T)<Q,, R{s,T)<R,, R{s,t) < R,, se[0,T] 

G{T) < G», G{T) < G,. 

ForO<k<N -1, let 



(6.2) 



Pk+PkA+A'^P^+C^PkC+Q^ - {PkB + C'^PkD){R^+D^P^D)-\B^P^ + D^P^C) = 0, 
P* + P^A+A^P^+C'^P^C+Q^ - {P^B + d'^P^D){R^ + D^P^D)-\B^P^ + D^P^C) = 0, 

s e [ife,ife+i), 

[ p,*(ife+i) = r^(ifc+i), p,*(ifc+i) = p;+i(ife+i), 

where for 1 < k < N — 1, 



(6.3) 



with 



ti_, + ri_,{A - Bei) + {A- BQifri_, + g. 
+{d - Deifp*{c - DSD + {eifRM = o, 

ri_j{tk+i) = ri{tk+i), 

ei = {R. + d^p;:d)-\b^p^ + o^p^d), s e [tk,tk+i] 
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s e [tk,tk+i), 



0<k< N -1. 



and with the convention that 
Further, for < k < N - I, let 

ill + KA + A^ni + c^nic + g, = o, sg [tk,tk+i), 



(6.4) 

and 

(6.5) 

Then 

(6.6) 



n, + n,l + l^n, + G^n,G + Q, = o, se [o,r), 
n,(r) = G,. 



sG[tk,tk+i], Q<e<k<N~l, 



< Te{s) < Pk{s) < P^{s) < niis), 
< fe{s) < Pk{s) < P^{s) < n^s), 

with the convention that r_i(s) = r_i(s) ~ 0. 

Proof. Wc look at the case k = N — I. Recall that 

Pn-i+Pn-i^ + A -Pjv-1 + G Pjv-iG + Qat-i 

^{Pn-iB + C^Pn-iD){Rn-i + D^Pn-iD)-\B^Pn-i + D^Pn-iC) = 0, 
Pn-1 + Pn-iA + A^Pn-1 + O^Pn-iC + Qn-i 

-{Pn^iB + C^Pn-iD){Rn^i + D^Pn-iD)-\B^Pn-i+D^Pn-iC) = 0, 

s E [ijv-i,^Af), 

, -P/V-l(iAf) = Gn-1, PN-l{tN) — Gn~1- 

According to Proposition 3.2, together with the usual comparison of solutions to Riccati equations, we have 



(6.7) 



< Pn Ms) < P*N -lis) <Tl%^i{s), 

< Pn-i{s) < p;,Ms) <n%_,{s), 



S e [tN-l,tN] 



Define 



eAr_i = {Rn-1 + D' Pn-iD)-\B' Pn-1 + D' Pn-iC), 



Qn-i = {Rn-1 + D'^Pn-iD)-\B^ Pn-1 + D^Pn-iC), 
Then Riccati equation system (6.7) can be written as 

Pn-1 + Pn-i{A - BSn-i) + {A- BQn-i)^Pn-i + Qn-i 

+(G - DeN-i)'^PN-i{c - dOn-i) + el_^RN-ieN-i = o, 

Pn-1 + Pn-i{A - BQn-i) + {A- BQn-i)'^Pn-i + Qn-i 
+(G - DeN-i)'^PN-i{d - BOn-i) + O^.^Rn-iOn-i = 0, 

PN-l{tN) = Gn-1, -PAf-l(ijv) = Gn-1- 

Next, for ^ == iV - 2, A^ - 3, • • • , 2, 1, 0, we recall 



S G [tN-l,tN]- 



(6.9) 



s e [tN-i,tN), 



(6.10) 



r, + re{A - bQn-i) + {a- BeAr_i)^r, + q^ 

+ (G - DeN-i)^fi{G - DQn-i) + {eN-i)^ReON-i = 0, 

r«(ijv) — Gi, 
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S e [tN-l,tN), 



r, + T,{A - BQn-i) + iA- BQN-ifre + Q, 

(6-11) \ +{C-D%N-lffi{C-bQN-l) + {QN-lfRl^N-l=(), .se[tAr_i,tjv), 

r£(ijv) = Gf, 
and 

f, + r,(l - Bejv-i) + {A- B&N^iffe + Qi 

^e{tN) ~ Gi. 
Comparing (6.7) with (6.10) and (6.12), making use of (H3), we see that 

(6.13) io<Us)<P^^,{s), ,g[,^_^,,^]^ 0<^<iV-2. 

[0<r,(s)<pAr_i(s), 

This proves (6.6) for fc = A^ — 1. The proofs for general k — N ~ 2,N ~ 3,- ■ ■ ,2,1,0 are essentially the 
same. □ 

Since !!,(■) is bounded uniform in A, we see from (6.6) that Tk{-) and Pk{-) are uniformly bounded. We 
now establish the uniform boundcdness of rfe(-), Tk{-) and Pk{-)- 

Proposition 6.2. Let (H1)-(H3) hold. Then rfc(-), rfe(-) and Pk{) arc bounded uniformly in partition 

A of [0,T]. 

Proof. Let P^i-), n^(-) and Tl{-) be as in Proposition 6.1. Choose (3 > \\R{- , •)||oo large enough so that 

(6.14) /?>|ia(-)|!oo||5(.)|loo|P,*(s)|, se[tk,tk+i], 0<k<N-l. 
Then 

(6.15) DisfP^is)C{s)CisfP:is)D{s)<[pi + DisfP^is)Dis)]\ se[t,,t,+i], < fc < iV - 1. 
We claim that 

(6.16) |e^(s)|</3-i||B(-)l|oo||n*(-)lloo + l, se[tk,tk+i], 0<k<N-l. 
In fact, by taking R^, = /3I, we have 



< (i?* + D^P^D)-^D'^P^CC^P^DiR^ + D^P^D)"^ 



= (i?* + D' PkD)-' D' P;CC' P^D - {R, + D' P^Dy {R, + D' PkD)-' + 1 <I 

Then 

le^l < \{R.+D^P^D)-'\\B\\P^\ + \{R,+D^P^D)-'D^P:C\ < r'\B\\Il^A + 1, 
from which one obtains (6.16). 

Next, we recall the equations (6.3) and (6.4) for rj^(-) and nj^(-). Define 

N-l N-1 

nis) = E rfe-i(s)/(t„t.+,i(s), niis) ^ J2 nfc(5)/(t„t,+,i(s), s e [o,t]. 
fc=i fc=i 

42 



Let us begin on {t]\[-i,tN]. We have 

\Ul{s)\ = |n^_i(s)| < \G, 

ftf 
<|G, 



with 



and 



with 



Thus, 



.17) 



(2|^(r)| + |C(r)p)|n^_i(r)| + |Q, 



dr 



dr, 



2||A(.)||oo + r(.)||^^ |n^_i(r)| + |Q,| 



\G^\ + \Q^\{tN~s) + Kn \Tll{r)\dr, s £ [tN-utN] 

Ku = 2\\A{.)U + \\C{-)\\l. 



\Tlis)\ = |r^_2Gs)l < \GA 



2\A{r)-B{r)e*^_,is)\\r*^_,ir)\ + \Q,\ 



+ \C{r) - D{r)e%_,{r)\'\P*^_,{r)\ + \R.\\e%_,{r)\' 



dr 



< \G, 



2 ||A(.)l!oo + ||i?(-)lloo(/3-i||s(-)lloo||n,(.)||oo + 1) |r^_2M| + IQh.1 



+(r(-)lloo + P(-)lloo(r'l|s(-)lloo||n,(.)||oo + i)J |n^_iM| 
+|i?,|(/3-is(.)||oo||n,(-)lloo + i)']dr 

P^^ r ~ 1 

G,\+KQ{tN-s)+ Kr\rl{r)\ + Kn\ni{r)\ dr, se[tN-i,tN] 



Kr = 2(||A(.)I|oo + llB(-)lloo(/3-'||S(.)|[oo||n,(-)||oo + 1)), 
Kn = (llC(.)lloo + ||5(.)||oo(/3-iB(-)lloo||n*(-)lloo + 1))', 

I Kq = |Q,| + |i?,i(/3-i|iB(.)|loo||n*(-)lloc + 1)'. 



|ni(s)| + |rx(s)| 

<2\G,\ + {\Q,\+KQ){tN-s)+ I {KnVKn)\Til{r)\+Kr\Tl{r 



dr. 



<2\G,\+2KQ{tN-s)+ I {Kn + Kn)\Tll{r)\ + Kr\rl{r)\ 
Next, on {tN-2,tN-i], 



dr 



|ni(s)| = |n^_2(s)|<|r^_2(ijv_i)| + 



(2|A(r)| + |C(r)|2)|n^„2(r)| + |Q, 



dr 



Ka\n*j^^2ir)\ + \Q*\]dr 



= \G,\+KQ{tN-tN-i)+ i^Kr\r%_^{r)\+Kn\n%_,{r)\jdr- 

i^Kr\r*j^^^{r)\ + Kn\n*j,,_,{r)\jdr + Kn J \U%_^{r)\dr, 



S € [tN-2,tN-l], 
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and 



|rX(s)| = |r;._3(s)| < \r*^_2(tN-i)\ + / 2|A(r) - Bir)e%_,{s)\ |r^_3WI + \Q*\ 



\C{r) - D{r)e%_^{r)\'\P*^_^{r)\ + \R4\e%_^{r)\ 



dr 



< 



\G,\+KQ{tN-tN-i)+ r (AV|r^_2(r)|+7^n|n^_i(r)|) 



dr 



In -1 



Kr\T*r,-:,{r)\+Knm,^^{r)\ + \QMdr 



Then 



(6.18) 



G,\+KQ(tN~s)+ [KT\T\{r)\+Kn\n\{r)\\dr, s S [tAr_2,ijv-i] 



|nl(s)| + \Tl{s)\ <2\GA+ 2KQ{tN -s) + 2 [Kr\Tl{r)\ + i^nlH^ Wl j^'^ 

iKu + Ku)\Ul{r)\+Kr\T*^ir)\ dr, s £ [t^_2,iiv-i] 



By induction, we can show that 



|nl(s)| + \Tlis)\ < 2|G,| + 2KQiT - s) + (i^n V An + An)|nl(r)| + 2ifr|ri(r)| 



dr 



<2|G,|+2ifQ(T-5) + /vo / |ni(r)| + |rX(r)| dr, sG[0,r], 



with 

ATo = maxj/sTn V A'n + ^n, 2Kr}. 

Hence, by GronwaU's inequahty, one obtains 

|nA(s)| + \Tlis)\ < 2(|G,| + XQT)e^°^, s G [0,r], 

which imphes 



Note that 



Ko<Kn + 2{Kn + Kv) 

= 2P(.)||oo + ||G(.)foo + 2(||C(.)||oo + ||5(.)|U(r'l|S(-)||oo||n*(-)l|oo + 1) 

+ 2(||A(.)||oo + ||B(.)||oo(r'||S(.)||oo||a(-)l|oo + 1)) 
< 2P(.)||oo + ||G(.)||L + 2(||C(.)i|oo + ||5(.)||oo(||S(.)||oo|ia(OI|oo + 1)' ' 

+ 2fi|l(.)||oo + ||B(.)||oo(0(.)||oo||a(-)l|oo + 1)) ^ A-0, 



and 



Kq < 10*1 + |i?*l(l|s(-)||oo||n*(-)lloo + 1) ^ Kq, 

with Kq and Kq being absolute constants. Now, we may take 

/3 = l + 2(|G.|+XQT)e^«^||a(.)||oo||5(.)||oo. 
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Then (6.14) holds and we obtain uniform boundedness of -P^ (•): r^(-), and n^,(-). Consequently, from (6.6), 
we obtain the uniform boundedness of -Pfe(-) and rs,(-). Finally, by the equation (5.41) for Tk{-), we obtain 
the uniform boundedness of rfc(-). □ 

The following result essentially gives some estimates on the jumps. 

Proposition 6.3. Let (H1)-(H3) hold. Then 



(6.19) 



and 



(6.20) 



\Gk-Gk-i\+ f {\Qk{r) - Qk-i{r)\ + \Rkir) ^ Rk-iir)\)dr\, sG [ifc+i,tiv] 



< K 



\fk{s) - f,_i(5)| < K[\Gk - Gk-i\ + \Gk - Gk-i\ + J {\Qk{r) - Qk-i{r)\ 

+ \Rkir) - Rk-iir)\ + \Qk{r} - Qk-iir)\ + \Rk{r) - Rk-i{r)\]dr 

s e [tk+i,tM]- 



Proof. Under (H1)-(H3), we know that Pk{-),Pk{-) are uniformly bounded. Thus, all the eoefficients of 
the Lyapunov equations (5.40)-(5.42) and (5.47) are bounded. Now, comparing the equations for Tk{-) and 
^k-i{-), we have 



..21) 



\Tkis) - Tk-iis)\ < \Gk - Gk-i\ +K I (|rfe(r) - r;,_i(r)| + \Tkir) ~ r;,_i(r)|)dr 

+Kf "(iQfc(r) - Qk-iir)\ + \Rk{r) - i?fc-i(r)|)dr, s E [<fc+i,tw]. 
Next, comparing the equations for Tk{-) and rfe_i(-), we see that for s G (<7v_i,tAr], 



\Tkis) -Tk-i{s)\ <\Gk- Gk-i\+ K / \Tkir)-Tk-iir)\d 



+K 



\Qk{r) - Qk-iir)\ + \Rk{r) - i?fc_i(r)|)dr. 



For s e (ijv-2,iw-i], 



|rfe(s)-rfc_i(s)| < \Tk{tN^i)-rk-i{tN-i)\ + K / \rk{s)-rk-i{r)\dr 



+K 



(iQfc(r-) - Qk-iir)\ + \Rkir) - i?fe_i(r)|)dr 



<\Gk-Gk-i\+K 



+K 



-K 



In-i 

tN -1 



\Tk{r) - Tk-i{r)\ + \Tkir) - Tk^i{r)\]dr 



\Qkir) - Qk-i{r)\ + \Rkir) - i?fc_i(r)|)dr 



Tk{s) - Tk-iir)\ + lOfe(r) - Qfc_i(r)| + |i?fc(r) - i?fc_i(r)| dr 



<\Gk-Gk-i\+K 
ft 



r,.(r) - rfc_i(r)| + \Tk{r) - rk-i{r)\)dr 
+K I " [\Qk{r) - Qk-iir)\ + \Rk{r) - Rk-iir)\)dr. 
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For s G (ijv-3,ijv-2], 



\T„is) ~Tk-i{s)\ <\T,{tN-2) -rk-i{tN-2)\+ K / \Ttis)-Ttiir)\dr 



'K 



<|Gfc-Gfe_i|+A' 



tN 



^N -2 
tN--2 



[\Qkir) - Qk-i{r)\ + \Rk{r) - Rk-i{r)\]dr 
iTkir) - rfe_i(r)| + \fkir) - rfe_i(r)|)dr 

\Qk{r) - Qk^i{r)\ + \Rk{r) - i?fc_i(r)|)dr 
fk{s) - ffc-i(r)| + IQfc(r) - Qfc-i(r)| + |i?fc(r) - i?fe_i(r)| )dr 



+A' 

+A' 
< |Gfc - Gk-i\ +K I [jTkir) - rfe_i(r)| + {Tkir) - rk-i{r)\]dr 
+K r {\Qu{r) - Qfe_i(r)| + \Rk{r) - i?fe_i(r)|)dr. 
By induction, we see that 



\Tk{s) - Tk-i{s)\ < \Gk - Gk-i\ +K I i^\Tk{r) - Tk-i{r)\ + \Tk{r) - rk-i{r)\jdr 

+K f "^ {\Qk{r) - Qk-i{r)\ + \Rk{r) - Rk-i{r)\yr, s G [tk+i,tN]. 
Combining (6.21), we obtain 

\Tkis) -rk-i{s)\ + \fk{s) -fk^i{.s)\ 

< 2\Gk - Gk-il+KJ " (|rfe(r) -rfc_i(r)| + |ffe(r) - ffc_i(r)|)dr 

+K f (|gfe(r)-Qfe_i(r)| + |i?fe(r)-i?fe_i(r)|)dr, se[ifc+i,iw]. 

By Gronwall's inequality, we obtain (6.19). Similarly, comparing equations for rfc(-) and Tk~.i{-), we obtain 

|ffc(s) - rfe_i(.s)| < \Gk - Gk-i\ + K / \fkir) - fk-i{r)\dr 



+ / ilQkir) - Qk-iir)\ + \Rk{r) - Rk-iir)\ + \Tk{r) -Th-iir)\]dr^ 



By Gronwall's inequality, we obtain (6.20). 

Now, for given partition A of [0,r], let us denote 

JV-l 



3.22) 



< 



N-l 



Q^is) = E Q(^'ifc)^(t.,t.+d(«)' Q^i') = J2^i^^tk)iit,,t,^,M 



k=0 



k=0 

N-l 



se [0,tN]. 



R^is) = E i?(s,ifc)/fc,t,+,](s), R^is) = E Ris,tk)Iit,,t,^,]is) 

k=0 k=0 

The dependence on the partition A is indicated. Denote 

N-l N-l 



3.23) 



^^(^) - E ^fc(«)^(t.,*.+i]W' ^^(«) = E ^fc(«)^(u.t.+.](«), « G [0,i^], 



fc=0 



A:=0 
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and 



(6.24) 



N-l 



fe=0 
JV-1 

r^(.,r) = ^ r^(5)/(*,,,,,,,](r), < r < . < t^, 

A:=0 

JV-1 

f'^(s,r) = 5]f^(s)/(,,^,,,^,](r), 



fc=0 

with the foUowing extension on [0,tAr] x [0,tAr] as follows: 

(6.25) r^(s,r)=r^(r,r), r^(s, r) = r^(r, r), f ^(s, r) = f ^(r, r), se[0,r]. 

Note that s i-^ (r^(s, r), f '^(s, r)) is continuous on [0, T], whereas s i-> ^'^(s, r) might have jumps at s = tk, 
withifc G [T,r]. 

From Propositions 6.1 and 6.2, we have the uniform boundedness of P'^(-), i-"^(-), r'^(- , ■), r'^(- , •), 
and r'^(-,-)- This implies the equicontinuity oi s ^ {P^{s),P^{s),f'^{s,T),r^{s,T),f^{s,T)) on each 
{tk,tk+i), for fixed T G [0,r]. Also, from Proposition 6.3, we see the jump sizes of the above functions 
are controlled by the mesh size ||A|| of the partition A, thanks to the continuity of functions (s,i) ^^ 
(g(s, t), Q(s, i), i?(s, t), R{s, i), G(i), G(t)). 

Finally, we will need the following result which is a kind of extension of the well-known Arzela-Ascoli 
Theorem. 

Lemma 6.4. Let /j. : [0,T] — !> M", fc > 1, be a sequence of uniformly bounded piecewise continuous 
functions. Suppose that for any e > 0, there exists a 6{e) > and a fco(e) > 1 such that 

(6.26) |/fc(t) - A.(.s)| < e, V|t - .s| < J(e), k > fco(e). 

Tiicn tiicre exists a subsequence fk {■) s,nd a continuous function f : [0,T] -^ M" such that 

hm ||/fe,(-)-/(-)lloo-0. 

Sketch of the Proof. Let Q[0, T] = {ri,r2, • • • } be the set of all rational numbers in [0, T]. Without loss 
of generality, let us assume that all the functions /&(■) are right-continuous. First consider the sequence 
{fk{ri)}k>i which is bounded. Thus, we may have a convergent subsequence, denoted by, {fai(j)ii"i)}j>i Q 
{fk}k>i- Next, consider sequence {fcri{j)i'i^2)}j>i- By the boundedness, we again have a convergent subse- 
quence {/o-2(j)(''2)}j>i C {/cri(j)(''2)}j>i- Continuing the procedure, and using a usual diagonal argument, 
we obtain a subsequence {fkj{-)}j>i and a function f{r) defined for all r G Q[0,T] such that fkj{r) — >■ f{r) 
for all r G Q[0,T]. By (6.26), we see that /(■) is bounded and continuous on Q[0,T] which is dense in [0,r]. 
Then one can extend it naturally to a continuous function on [0, T]. Further, we see that our convergence 
holds. D 

With the same argument, we see that the above result holds if [0, T] is replaced by [0, T] x [0, T] (actually, 
[0,T] can be replaced by any compact metric space). The point here is that the functions fk{') arc not 
necessarily continuous, which will be the case in our problem. 

Having the above preparation, we are now at the position of stating and proving the following convergence 
theorem. 
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Theorem 6.5. Let (H1)-(H3) hold. Then 

lim f|f^(.S,T) -r(.S,T)| + |r'^(.S,T) -r(.S,T)| + |f^(s,T) -f(s,t)| 



3.27) 11^11-^0 

+|F^(s)~r(s,s)| + |p-(,s)-r(s,s)|)=o, 



uniformly in (s, r) G [0, T] x [0, T] with r(- , •) and T{- , •) satisfying (4.30). 

Proof. Let a partition A : = to < • • ■ < iw = ?" of [Oi ^] be given. By our condition and Proposition 6.2, 
we have the boundedness oi T'^{s,t), r^{s,T) and T'^{s,t). Then noting that r'^(-,-) etc. satisfy proper 
differential equations, we have 

|rf(s,T)| + |ff(s,T)| <i^, S^T, T^tk, 0<k<N, 

(6.28) <; |ff(s,r)|<A', s^r,ifc, < fc < iV, 

\P^{s)\ + \P^{s)\<K, s^tk, 0<k<N, 

with some uniform constant K > (independent of partition A). The above imphes that 

|r^(s,T)-r'^(.s,T)| + |r'^(.s,T)-r'^(s,r)| </v|s-s|, s,s& [o,r], re [o,r]. 

On the other hand, by Proposition 6.3, for any t, f G [0,T] with 

|t - f| < min |tfc+i -tk\, 
a<k<N-i 

we have 

|r'^(s,r)-f^(.,f)| + |r^(.,r)-r^(s,f)| + |r^(s,r)-r^(.,f)|<cD(||A|||), 

with (!'(•) being a modulus of continuity. Then by Lemma 6.4, we have 



hm |r^(s,r)-r(s,r)| + |r^(s,r)-r(s,r)| + |r^(s,r)-r(s,r)| =0, 

||A||-i.O V / 

for some continuous functions r(-,-), r(-,-), and r(- , •). 
Next, let s G [tfc+i,tfc+2)- Then 

|P^(s)-r^(s,s)| <\Pk{.s)-Pk{tk+i)\ + \rk{s,s)~Tk{s,tk+i)\<K\\A\\, 
|P^(s) - r^(s, s)| < \Pk{s) - Pk{tk+i)\ + |ffc(,s) - fk{tk+i)\ < K\\Al 

and for < T < s < T, let r e [^^+1,^^+2), and s G [^^+1,^^+2), with £> k, then 

|f '^(s,r) - r^(,s,r)| = \ftis) - re(s)| < \ftis) r^(i.+2)| + |r^(i.+2) - rt{s)\ < k\\a\\ 

Hence, we have 

IIAIKoV 
Consequently, 



with 



lim |r^(,s,r) -r(,s,r)| + \P^{s) - T{s,s)\ + |P^(,s) - r(s, s)| = 0. 

||A||-!-0 V / 

lim fe'^(s) - e(s)| + le'^(s) - 6(5)1) = 0, 

||A||^o V 7 

Q{s) = [R{s, s) + D{s)T{s, s)D{s)\ "' [B{sfV{s, s) + D{sfV{s, s)C{s)\ , 
e(s) = [^(s, s) + D{s)T{s, s)D{s)\ '^ [B{sff{s, s) + D{sfT{s, s)C{s)\ . 
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Then we see that r(- , •) and r(- , ■) satisfy (4.30). D 

Note that the above convergence result gives an existence of a solution (r(- , •), r(- , •)) to the Riccati 
equation system (4.30). To be complete, we have the following result. 

Theorem 6.6. Let (H1)-(H2) hold. Then (4.30) admits a unique solution. 

Proof. We need only to prove the uniqueness. We denote 

and rewrite (4.30) as follows: 

A,(s, r) = Fis, T, A(s, r), A(s, s)), < r < .s < T, 

A(r,r) = Ao(r), 

where i^(s,T, 7,7) is some continuous map which is differentiablc in (7,7). Now, suppose there are two 
solutions A^(- , •) and A^(- , ■). Then 

A(.,.) = Ai(.,.)-A2(-,-) 

satisfies 

A^(s,r) = F^{s,t)L{s,t) + F^{s,t)A{s,s), < t < s < T, 

A(T,r)=0, 

for some continuous (matrix-valued) functions F.y{s,T) and F^{s,t). If we let $(•,•) be the fundamental 
matrix of F^ ( ■ , • ) , then 

A(s, t) = / $(r, s)<^^{r, T)A(r, r)dr, 0<t <s <T. 

Set s = r in the above, we end up with the following 

A(t,t)=/ $(r, s)$-^(r,T)A(r,r)dr, < t < T. 

This is a linear homogeneous Volterra integral equation with a continuous kernel. Hence, it is necessary that 

A(s,s) = 0, se[0,T]. 

Then, 

A(s,t)=0, 0<t<s<T, 

which leads to the uniqueness of the solution of (4.30). D 

Combining the above, we can easily obtain a proof of Theorem 4.5. 
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